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ote: Much excellent research has beet ! 
teaching of arithmetic. The authors offer a study of the 
tic Its of the various elements in long divisi pl 


pupils in grades 5B to 6A 


nt vears there have been numerous investigations of the teach 


} £. 
letalled 


division. There are available, for example, the « 
s of the skills in long division by Upton', Grossnickle*, and others 
as shown that under carefully supervised conditions this 


ht at the fourth grade level. Grossnickle has shown 


PSS be tau 


pupils to estimate quotient figures by either the increas 
or by the apparent method. produces about equally vood 
+ 


+} 


e most influential study in long division which has ye 

cen is that of the Illinois Committee of Seven’. This com 
lucted an experiment on a large scale to determine the optimum 

ch to teach the entire process to completion. Originally the 
| roposed that the process of long division should be taught ti 
e minimum mental age of about 12 years 6 months. In reports 
estigations of the committee it has been ear fully indicated 


nmittee made no recommendation as to the points at which 


‘ B. ‘Making Long Division Automatic,’’ in The Teach 1 of Arith 


rhbook of the National Council of Teachers of Mathematies (New 
College Press, Columbia Universitv. 1935). pp. 251-289 
Foster E. ‘‘Classification of the Estimations n 7 Met s of 


in Long Division,’’ Elementary School Jo © Bay \ 


Foster E, ‘‘An Experiment with Two Methods of Estimating 
y School Jo , XXXVITI (May, 1937 668-677 
atone bibliography of the publications of the Committee of Seven is giver 
llowing article by C. Washburne, ‘‘ The \ es. | : 
Findings of the Committee of Seven,’’ Jou of I 


n, XXIX (May, 1936), pp. 694-707 
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the easier elements of the process ean be taught effectively. This : 


was left open for further study by others interested in it. Dy 


to where to introduce the easy steps in the process were left 
groups of teachers and curriculum workers, whose judgments 
nately were unsupported by any scientifie evidence as to th ' 
difficulty of the various elements. 
The general recommendation of the Committee of Sever 
attacked for a number of reasons*®, among them the inadequ 
test used to measure achievement in long division which consist 
only ten examples, four of them with one figure quotients, the f 
he test to cover adequately all major elements and difficulties 
process, the unreliable measures of mental ability used, the 
that the instructional materials used were not constructed as 
as they might have been with the information now avail 
ek of cont of conditions under which the teaching was « 
eriterion set ». namely 80 percent mastery—eq 
t of error—by 75 percent of the pupils on a retention test f 
six weeks’ period in which there was no practice on thi 
also been severely criticized on the ground that it does not r 
isual plan of determining mastery. The committee has repli 
school is quite free to set up some other eriterion more accept 
group concerned. The degree of accuracy set up by the comn 
eriterion of maste ry amounts to at least 60 percent for a class as 
assuming that three-fourths had scores of 80 percent and the re! ft 
scores of 0 percent). The higher the percent of accuracy) 
those who had at least 80 percent of mastery the higher \ 
This result would also be true the nearer t! { 
below t tandard of 80 percent approached it. It thus 
the criterion set up by the committee when translated into 
‘curacy for the group as a whole would be about 75 pereé 
the eriterion that will be employed throughout the present st 
suggested index of mastery to be used as a basis of gradatior 
indices are not strictly comparable, yet they enable us to 1 
comparisons between the results of the study of the Committ: rs 


and the present investigation. 

The point has also been made by crities that even if the 
long division can be taught to pupils of the minimum mentai ag 
vears 6 months, we have no right to assume that it should be taught! 

‘Brownell, W A. ‘*Readiness and the Arithmetie Curricul 
School Journal, XXXVIII (January, 1938), pp. 344-354. 
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hese erities hold that long division should be taught when it meets some 
| need of the individual. They claim that no one has yet determined 
-eystematic research the point at which the actual need of this process 
'S UnfortalMices in the normal activities of children. Some of them would go so 
s to delay the teaching of long division until late in the school, as 
as grades 7 and 8, on the ground that it does not function in life 


t has be ‘il even later on. It appears that we need at least two additional types 





acy ‘research in long division, namely, studies of the need of long division 
msist e lives of children, and studies of methods and materials for teaching 
failur e process to pupils at various stages of development so that the process 
tes e taught suecessfully at various points in the curriculum when the 
poss for mastering it may arise. Ideally the process should be taught 
eff en there is a definite need for it and by means of materials and methods 
e lanted to the level of development of the individual learner. No one 
one ws the results that would be secured by such a program. On the other 
lent to 3 | the fact that long division can be taught at any given point in the 
tf uricnlum is not a valid reason for teaching it at that time. It is possible 
rocess, LMMhat the process could be mastered much more easily and permanently if 
resent st were delayed for one, or two, or even more years. No one knows. It 
1 ti hay be that instead of teaching the whole process to completion at one 
able tot me it would be desirable to arrange the teaching program in such a way 


nmittee Mat the learning would be spread over a number of vears, the easier 


iS a lements coming earlier in the program and the more difficult elements 
remain a later time. It is with this problem of gradation that this article is 
hic neerned., 
ld We wish to report the results of a study, made at the University of 
wi esota, of the relative difficulty of the various elements in long 
pears vision with two-place divisors for pupils in grades 5B to 6A in a typical 
pert ol system. The rudiments of the process are taught in this system 
t. T! grade 4A and the process is completed in grade 5B or early in 
tudy le 5A. The method of teaching used in the basie textbook is the 
| The t™ ase-hy-one method for all divisors ending in 6, 7, 8, and 9. The 
ike use ers of the classes concerned are all rated as successful and in the 
of Serta ree schools coneerned there are principals who are rated as superior. 
schools are all located in average residential areas. About 600 pupils 
process © ere tested and complete data were secured for 474 pupils. 
age of lwo tests in long division were administered. Test A, administered 
ight thee three parts, consisted of 32 examples in each of which there was only 


Element ne place quotient figure, with or without a remainder. The divisors 
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covered all deeades and the second figures in them were well distr 
from 0 to 9. The pupils were told to express the remainders ; 
quotients as remainders, not as fractions, so as to eliminate any dif us hi 
due to reduction of fractions or the use of decimals. The examples ®t 
so constructed that all major combinations of skills and dlifficultis 
naming quotients were tested. The test included 20 examples 
the apparent quotient is the true quotient, and 12 others in wi 
apparent quotient is 1, 2, 3, or more too large, when the apparent 
of estimating the quotient is used, or in which the divisors wen 
The examples in the test are defined in Table I. Test B, adn 
in two parts, consisted of 36 examples involving two- and t 
quotients, zero difficulties in quotients, remainders, and diffe 
naming the kinds of quotients that were tested in Test A. The t 
defined in Table IV. Thus, in each test there were items, usu: 
each subtype, that ranged from very simple to very difficult, or 
There was no time limit on any of the tests. The tests wer 
in November of 1938. 

To get a measure of the relative difficulty of each type of ex 
was assumed that the percent of error by pupils who have be 
the process would be the best index, much as has been done in sp 
and other subjects. This procedure is obviously not as accept 
determination of learning difficulty under carefully controlled cor 
as was done, for example, for addition combinations by Knig 
Behrens®. The data here reported represent difficulty only i 
the measure of the ability of the pupils to solve the examples 
have been taught the process is a measure of their difficulty. 1 
have been analyzed by half grades and by mental ages. The r 
the three schools are combined in the tables that follow. Data 
secured as to the length of time required to solve each of the 
to get a further index of the difficulty. These data are not yet 
Preliminary analysis of the results indicates that there ar 





variations in the amount of time pupils require to work th 
examples. , 
In Table I are given the percents of error for each grade 


TY 


6A for the various types of examples. From the data in row 
be seen that the average error for all types of examples combined 
from 46.0 in grade 5B to 28.7 in grade 6B. There was a slight 
in percent of error from grade 6B to grade 6A. The proposed 
25 percent error set up as a standard for gradation was not 
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nd of grade 6A. It is interesting to speculate on what the results 


peuu 


Jd have been for grades 7 and 8. 

As has been shown, the examples can be grouped as of two types. 
mparing the data in rows (2) and (3) in Table I it can be seen 
the examples in which the apparent quotient is the true quotient 

much easier for the pupils in all grades than the type in which there 

t be a correction when estimating the quotient, since the apparent 

is too large. The difference between the means for the two 
types (rows 2 and 3) is greatest in grade 5B, namely 39.2 percent, 

n grade 6A, namely, 22.9 percent. 


Ail 


TABLE | 
PERCENTS OF ERROR BY GRADE ON EXAMPLES 
FIGURE QUOTIENTS GROUPED ACCORDING TO TYPE OF DIFFICULTY 
5A 6B 6A No. of 
103 143 103 Examples 
31.9 ¢ 
14.3 


0 43.8 28.7 
16.3 19.6 
3.8 to 34.9 9 to 36.2 ( 2 9 to 29.6 


a7 0 
Ol.e 


7.0 38.9 


53.0 40 
2 47 
3 


oo 


53.0 
34.9 18.0 
42.1 


53.4 3 
33.6 to 67.2 16.5 to 50 15.7 to 50.{ 


» 10 


e quotient figure is 9 although it appears to be 
to be 10 or more 


at the quotient figure is 7 or 8 although it appears 


fferences in these percents of error are very striking in all 
les. They show that there is a marked difference in the difficulty of 
two major types of examples. The ranges given in rows 2a and 3g 
that there is a wide variation in the difficulty of the various 
les included in each of these major groupings. In grade 5B these 
inges do not overlap at all; they overlap only slightly in grades 
1 6B; and they overlap considerably in grade 6A. These facts 
t that there is a clean cut difference in the difficulty of the two 
texamples. It is obvious that a mean degree of error of 25 per- 

we shall assume is a reasonable criterion for determining 
f steps in any process can probably be achieved for examples 
Fr. B., and Behrens, M. Learning the 100 Addition Combinations 


Subtraction Combinations, New York: Longmans, Green and Com- 
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of the first general type in grade 5B. For the other type this sta 
obviously not reached by the end of grade 6A. At this point th 
of error is still 37.2, approximately equivalent to what is apparen 
lowest possible limit under the basic Committee of Seven standard } 
ean also be seen from Table I that the percent of error on exam 
which the apparent quotient is the true quotient is less in grad 
in grade 5A, while the reverse is true for the examples in 
apparent quotient is not the true quotient. This situation s 
possible interference factor operating in grade 5A. 
In Table I the data for the second general type are further brik 
down according to six sub-types, for each of which the mean percent 
error for two examples of each sub-type are given. Each sub-t 
described in the table. The easiest sub-type in all grades is the ty 
divided by teens (row 3e). The most difficult sub-type in all ¢g 
the type (30238) in which the apparent quotient is 10 or mor 
which the true quotient is two, three, or four less than 
quotient. For all sub-types the percents of error are very larg 
decrease somewhat from grade 5B to grade 6B and then increasé 
in grade 6A. It is obvious that on the basis of the findings it w 
be earlier than the seventh or eighth grade that one should 
expect a degree of error of less than 25 percent, assuming t! 
sults here secured are typical of results in general. 
These data show conclusively, it seems to us, that on¢ 
speak of a process of long division as if it were one general 
general type or level of difficulty. It is clearly made up of a\ 
of combinations of skills of marked differences in difficulty 
evident that the two major types of examples, here considered 
be taught at the same grade level. 
The Committee of Seven recommended that the long divis 
should be taught to completion when the pupil has a mental ag 
years 6 months. The validity of this recommendation will 
sidered. 
In Table II the findings for each type of example wit 
quotients various sub-types are presented for a considerabl 
mental ages. Mental ages were derived from the Otis Self-Ad 
Test of Mental Ability. In this table the results for pupils of ¢ 
age for all four grades are combined. The data are arranged 
form as in Table I for each mental age group. 
According to the data in row (1) there is a general decreas 


cents of error for all ty pes combined from level to level of iit 
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TABLE II 
PERCENTS OF ERROR BY MENTAL AGE GROUPS ON EXAMPLES 
WitH ONE-FIGURE QUOTIENTS (GRADES 5B-6A COMBINED) 
Mental Ages in Months 


96- 108- 120- 
107 119 131 


60.1 51.6 34.2 
51.3 51.7 


75.0 


5.0 


] 


ental age group, 144-155 months, or from 12 years to 13 years, 
tal age recommended by the Committee of Seven for teaching long 
n, we find that the degree of error for all types of example with 
figure quotients combined, is approximately 25 percent. However, 
the total data are divided according to the two major types of 
tient difficulties, we find very large differences in the percents of 
‘all mental age groups. Apparently the standard of 25 percent 

s reached before the mental age of 120 months for the examples of 
irst major type, but it is not reached for the second major type until 
very earliest the mental age of 168 months, about four years later. 

in we have evidence that long division should not be regarded as 
general process to be taught as a major unit, but that it contains 

ber of different elements that differ very greatly in their difficulty 


‘ 


pils. If one accepts the idea of ‘pacing’’ instruction according to 

te of child development, present practices of teaching all types of 

sion examples with two-figure divisors in one grade are clearly 
and indefensible. 

points are even more clearly brought out by the data for the 

ent sub-types under the second major type. As was true when 

were arranged by grades, the type (tens-divided-by-teens) was 

t at all mental age levels and the type (302+38) was the most 

t all mental age levels. With the exception of the tens-divided- 

$s type all of the sub-types were so difficult that a mental age of 


ist 156-167 months was required to reduce the percent of error to 


tely 25 percent. The range in percents of error for the various 


is small for each of the mental age groups. The percents in 











general tend to dé 


ere 


ase 
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from left to right in the table, showing 


( onship between mental! maturity and suecess in mast ring « 
There ry s to be little difference in the difficult: 
ib-types in which the parent quotient figure either must 
1) or must be reduced (2), three (3), or more. There is a m:; 
nee in the diffieul \ of the two sub types involving teens, 0 
the lone divisio1 demons The sub ty pe, tens-divided hy 
learly much easier than the sub-type, hundreds-divided-by-te 
tter U) A ut IS a ‘demon.’”’ 
In passing it should be pointed out that of the ten examples 
the Committee of Seven retention test four had one-figure 
nd in three e four the apparent quotient was the t: 
Ss] ! ne of the four example S Was a correction necess 
ets se a serious que stion as to the validity of the test 
ty in long division since it was heavily loaded wit! 
lo bring out the w: \ in which the results are affected wh 
e level nd grade level are considered together the results 
mples are shown in Table III. The data are arranged by g 
of given mental ages in the grade. For example, there 
the el] ve 132-143 months in all grades. On the firs 
percents of errors for pupils of that mental ag 
( ded were 5.3. 5.4. 10.3. and 6.3 respectively. W 
le ls in grade 6A were about two years older eh 
il e of the same mental age in grade 5B vet the percents 
of this mental age considered by erade | 
An examination of the results for the other « 
e other mental ve vels will show that the gener: 
I yu these percents to remain qul constant 1! U 
N g mental age for all examples. There aré 
is to this general rule, for some of the othe r examples, d 
e limited number of eases there were in each grade for s 
} ve levels | se data suggest that me | ve 1S 
or etor to consider in deciding at what point 
mplete the tea g of any phase of the long division 
S o the ¢ elu 1 oO the Committee of Seven The 
t il rm be at the same orac level for all pu s 
of ¢ sles, ind ey the need of considering carefu 
m ised to adapt instruction to individua! diffe 
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TABLE Ill 
ERROR FOR PARTICULAR EXAMPLES BY MENTAL AGES FOR FOUR GRADES 


Grade Mental Age in Months 


5B 
5A 
6B 
6A 


5B 
5A 
6B 
6A 
5B 
5A 
6B 
6A 
nd test the same difficulties in long division were tested 


quotient figures was increased to two and three, and zero 


e quotient were included. The results of this test will be 


narized at this point. In general they support the findings 

reported for examples of one-figure quotients. 
ntains an analysis of the difficulty of the various types 
cluded in Test B. The data are so arranged by grades that 
readily be made with the results for one-figure quotient 

n Tables I and II. 

son of the results in Tables I and IV for all types of 
bined shows that the percents of error for examples with 
tients tend to be slightly less than those for longer examples 

xeept Grade 5B. (See line (1) in each table) 
son of the pereents of error in Tables I and IV for the 
pes of examples, examples in which the apparent quotient 
quotient and in which it is not (rows 2 and 3), shows that 
es there is a very large difference in each grade in the diffi- 
‘ec two major types of examples. The types in which the ap- 


| 
} 


t must be corrected are by far the most difficult through- 
the general tendency is for examples with two or more 
res to be more difficult than those with only one quotient 
examples containing similar skills are compared. Wide 
the difficulty of the sub-types are also found in both tables 
the pereents of error on all sub-types where the apparent 
st be corrected are very large, being as large as 70.4 percent 
! example in which a combination of the difficulties ineluded 
types of examples is found (row 3g). The easiest type is 


ich one figure in the true two-figure quotient is one less than 
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TABLE IV 
DIFFICULTY OF TYPES OF EXAMPLES IN LONG DIVISION FOR GRADES 
Two and Three Figure Quotients and Estimation Difficulties 


5B 4 4R 4A arp 
1. All ty; ned 42.3 48.1 11.8 7 
2 Apparent qu ‘ $ ru juotier 
types mbined 17.9 19.5 16.7 
a. Range on examples of type 11.2 11.7 11.2 10.7 ae 
42.4 31.1 40.7 28 
Apparent quotient is not true quotient 
types nbined 62 9.2 41.8 v.4 
a. Is 1 less than apparent 
(one figure) 42.4 35.9 25.9 6.2 
1 less than apparer 
(both figures) 60.( 60.2 47.9 43 i 
yy (96/9024) with or without 
mainder 68.4 63.6 48.7 52 
j yt (37/ 14) with or with 
mainde 69.2 ft 48.3 _ 
s 13/8 remainder 7.6 86.7 
m 7 18/1 r remaind 56.4 4f 25 4 
x ( na r (28/189¢ 7 t 70.4 51.7 s 
Rang xamples of type 42.4 ) 23.1 21.4 
7¢é 73.8 7.3 4 
n Quoti Tyt « 
4. A pes 7 48.1 1.8 7 
A ( fig ‘ qu t I e ~4 1.7 
t End nainder 48.4 i9 . 44 
Mid rind 4 44.7 28.7 
] Midd] r 2 ainder 7 4 O85 51.8 : 
Dou 1 j r r f 4.4 7.8 4 
f. Dout ninder f f 47. 
g. Rang xamples of ty] 14.4 24 ) 4.¢ 
72.8 6a =. 
N f ses 12 1 14 
the apparent quotient (row 3a). When both figures are one les 


apparent figures (see row 3b) there is a marked rise in 


difficulty of the example. Examples in which the teens art 


rows 3e and 3f) rank next in difficulty. 

The types of examples with zeros in quotients are In general s 
less difficult than the types in which the apparent quotient is not | 
quotient and much more difficult than the types in which 
quotient is the true quotient. There is a considerable range 
culty of the sub-types which have zeros in the quotients. The 
a zero in the second place in the quotient (row 4a) is easiest 


middle zero and a remainder (row 4d) is very difficult in al 
general the types in which there are remainders are the most 
The retention test of the Committee of Seven contained 
to four one-figure quotient examples, three examples wit! 
quotients and three examples with three figure quotients. I 


the ten examples the apparent quotients were the true quotients 
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IB 0 fA vily weighted with relatively easy types of examples. This fact raises 
er question as to the validity of the test as a measure of mastery 


liffieulty was tested. It is therefore evident that this test was 


Exempla ‘the total long division process. 
vet at the relation between relative difficulty and mental age the 
; ta in Table V are presented. Here the results are arranged by mental 
s for the various types of examples so that the results can readily 
. » compared with those of Table II which gives the data for examples 
. ‘the various types with one-figure quotients. 
lhroughout the table for all types of examples the general tendency 
percent of error to be smaller as the mental age increases. The 
| ereent of error for all types reaches 25 percent at the mental age level 
‘156-167 months (row 1). This is about two years later than that level 
| racy is reached for examples with one-figure quotients. 
types in which the apparent quotients are the true quotients are 
sier than the other type at all mental age levels (row 2 and 3). 
7 ent of error reaches 25 percent for the first type at the mental 
f 120-131 months, while for the second type this percent of 
s not reached until the mental age level of 168 or more months, or 
‘years later. For sub-types 3b, 3c, 3d, and 3g the percent of 
s not been reduced to 25 by the mental age of 168 or more months. 
lata for zero-in-quotient types show that the index of 25 percent 
75 pereent aceuracy, on the whole is not reached before the 
t ental age level of about 168 months, the same point as for the one- 
gure quotient examples in which the apparent quotient must be cor- 
ind the true quotient. There are wide variations among sub- 
the mental levels required to reduce the error to 25 percent; 
somewhtt mple, type 4a requires a mental age level of 108 to 119 months, 
to achieve this index of difficulty for several types apparently 
a mental age level of over 168 months, for instance, sub-types 
the dif #¢, and 4f, 
‘hese wide differences in the difficulty of the two or three major types 
The t i examples and among the various sub-types raise the question as to 
tness of the position of the Committee of Seven that the process 
g division should be taught to completion when pupils have the 


/ 


tal age of 12 years 6 months. Some of the easier steps can be taught 
wo-fig ttle earlier while others are so difficult that the problem should be 
R ously considered of reorganizing the program of teaching long di- 


so that the work is more effectively distributed. 
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TABLE V 


DIFFICULTY OF TYPES OF EXAMPLES IN LONG DIVISION BY MENTAL At 
FOR GRADES 5B To 6A COMBINED 


Mental Ages in Months 


96 108 120- 132- 144 
107 119 131 143 155 
I All types 15.9 52.1 17.9 15.8 1.9 2 
~ Appa n quoti st 
quotient 1.9 28.¢ 24.3 14.9 17. i 
Appar t quotier s not 
tr quotier 78.8 73.9 67.4 1.9 45.9 
‘ I (one figure) 75.0 50.0 47.8 8.3 28.1 l 
8 ss (1 figu 7 72.9 70.1 2.9 $7.5 3 
yy (96/9025) | ) 72.9 73.9 f 7.2 
Ty (37/3034) 100.0 81.3 72.8 9. ) 
I by teens 190 72.9 62 47.1 8.5 
f. Hundreds by teens l 66.7 ¢ 17.9 2 
g. Con ation types | ) 79.2 78.8 t 8 
‘ I ] ients 85.5 56.3 f 41.8 ) 
End r 4 ler 67 22.8 1 ) 17.4 
t I r ainds 75.0 47.9 2.8 43.8 8.9 
\I zer 
remainder l ) 8 ; 7 4.4 
i M ! r ainder 81 72.9 62.9 7 ; 
< Dou middle zer 
remainder 100.0 66.7 64.1 46.7 17.1 
f Double middl 
nainder 100.0 70.8 69.6 52 1.2 
Num ber f cases 4 24 IZ l 121 


We may summarize the major findings of this study and t 
tions for curriculum making as follows: 

1. Long division is not a single general ability but apparent 
process that consists of a considerable variety of skills found n 
tion varying widely in difficulty. 


2. It appears that the major type of example in which 
quotient is the true quotient is much easier for children of grades 
han the major type in which the apparent quotient must be « 
find the true quotient. This difference in difficulty is so gré 
position can easily be defended that the two major types sh: 
taught at the same grade level. It is doubtful if this difference 
culty can be reduced to any extent by possibly improved met 
materials of instruction. 

3. This difference in difficulty between the two major types !s 
emphasized by the data concerning the mental age level neces 
achieve an index of less than 25 percent of error in the various ! 
examples. The findings for mental age level required to 
standard for the major types classified according to kinds o! 
and difficulties based on the results of this study may be su! 


as follows: 
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One-figure quotients 

1) Apparent quotient is true quotient, mental age of 10 to 11 
years. 

2) Apparent quotient is not true quotient, mental age of 13 to 
14 vears. 

Two-and-three-figure quotients 

1) Apparent quotient is true quotient, mental age of 10 to 11 
years. 

2) Apparent quotient is not true quotient, mental age of 14 to 
15 years, 

}) Zeros in quotients, mental age of 13 to 14 years. 


we find a difference of at least two years in the mental level 


red to achieve an index of less than 25 pereent error on the two 


types of examples for either one- or two-figure quotients. If a 

higher index than 25 percent error is considered to be more 

e, the mental ages used as the basis of gradation would of course 
ied accordingly. 

i comparison of the figures for each major type reveals the 

| differences there are among the various sub-types included in 


group. This variability in difficulty should be taken into considera- 


the gradation of the steps in teaching the process, and also in in- 
mal procedure. 
In general the mental level required to achieve an index of less 


25 percent error was the same for examples with either one or with 


jotient figures when the apparent quotient is the true quotient. In 
her type there was about a year’s difference in the mental age level 
ed to reach the index of less than 25 percent error in solving 


s with one-figure and two-figure quotients. Examples with zeros 
juotients, some of which inelude these more difficult steps of cor- 


ng quotient figures, are about as difficult as examples with a one- 


juotient in which there must be a correction. 
The facts included under points 3, 4, and 5 above indicate what 


be an effective sequence of instruction. The need of carefully re- 
ng the recommendations of the Committee of Seven on this point is 


ndicated. It is very striking that the mental age level required 


nieve a level of less than 25 percent of error when all types of 


ples with one-figure quotients are combined and the mental age 


recommended in the report of the Committee of Seven are the same. 


r, in their report the Committee failed to differentiate between 


© level 


vel of difficulty of various kind of examples and did not include 
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many types in the test of achievement used as a basis of its recom 
tion. The present study supplies this essential information 

It should be pointed out in conclusion that the results of 
should not be considered as final. They represent conditions t 
from practices in one well organized schoo] System, where Sur 
competent, and where carefully prepared instructional mater 
used. It therefore seems reasonable to assume that the results of 
studies conducted elsewhere will not vield strikingly different 


However, it is quite possible that with even more carefully 


teaching materials and with improved methods of instruction t 
results in terms of accuracy of work man be somewhat better 
doubtedly the general conelusion concerning the relative difficult 
two major types and the various sub-types will not be 
considerable extent. 





BORROWING IN SUBTRACTION 


WirttiAM A. BROWNELL 
Duke University 
Editor’s note: It is a commonly recognized fact that borrowing in 
raction is a difficult precess for the average elementary school pupil. 
author reports the results of a research that should facilitate 
n this field and illustrate an approach to yet other problems 
I area. 
article by the writer in the May, 1938, issue of this journal 
+ referenee was made to an investigation not then fully completed." 


results of this study, which related to borrowing in subtraction in 
rd grade, have since been reported at some length in a monograph.* 


SS 


this monograph may not be accessible to the readers of 


ver, 
the present review and summary of findings has been 


THE PROBLEM 
generally agree that children experience difficulty in master- 
cess of borrowing in subtraction. To secure the correct answer 
235, little more is required of pupils than that they know 
subtraction facts and that they subtract the pairs of digits 
t order. The example, 467 — 239, is, by contrast, much more 
ere 9 cannot be taken from 7, and if the method of subtracting 
position is taught, a ten must be ‘‘borrowed.’’ 
is point textbooks are not very helpful either to teacher or to 
‘any explanation of the process is offered, the explanation com- 
kes the form of a rule, and the children learn what they are to 
t not why or how. After an adequate amount of repetitive prac- 
do get the trick, and they perform satisfactorily,—which is to 
t they regularly get the correct answer in examples of this kind. 
teachers of course have never been content with learning of 
nintelligent variety, and accordingly they have supplemented 
k presentation in one way or another. One device 
s been used consists in having the children change (A) 
f subtraction examples as illustrated at the right 
tens’ figure is reduced by 1, and the new tens’ 
s actually written on the work paper. Likewise, 
t the borrowed ten is visibly shown by the inser- 
William A. ‘*Two Kinds of Learning in Arithmetic,’’ Journal of 
earch, XXXI (May, 1938), p. 662, et seq. 
l, William A., with the assistance of Kuehner, Kenneth G., and Rein, 
ning as Re-organization: A Study in Third Grade Arithmetic. Duke 
Research Studies in Education, No. 3 (Durham, N. C.: Duke University 


’), x 87 + xx pp. 
415 
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tion of a small 1 above and to the left of the ones’ figure, t] 
17 instead of 7. 

Teachers who employ this device do not usually advertis: 
for they have been as much intimidated as have textbook writers 
oft-repeated dictum, ‘‘Other things being equal, form no habits 
must later be broken.’’ As a matter of fact, not one of the 
ten most recently published textbook series suggests this aid 
to children. One series makes use of the form shown at (B), 
and another outlines the form of thinking which is repre 
sented by (A) above; but no textbook author has dared to 
brave the opposition which would be aroused by recom 
mending (A). So deeply have warnings against ‘‘erutches’’ ¢ 
thinking that we hesitate to expose children to devices whic 
helpful in initial learning they may appear to be, may ren 
nently to impede advance to finished or expert performance 

Yet, on the surface of things, there seems to be some virt 

A). If children encounter difficulty in borrowing, it may b 
they do not understand what they are doing and because, midw 
process, they lose their bearings and become confused. Devic 
ceivably could prevent error and confusion: It gives a tangil 
of what must be done and of what has been done. Of course ther 
possibility that the device does not even approach the real s 
children’s difficulty in borrowing. There is the further possibi 
even if it does, the ultimate consequences, in terms of sl 
work, impaired accuracy, and infantile reliance upon a crute 
so bad that the device should not be taught. 


The best way to find out whether device (A) is helpful 


seemed to be by experiment. 


EXPERIMENTAL PROCEDURE 


The procedure adopted called for four experimental groups 
jects. One group of subjects (the NC, or non-erutch sectior 
taught the crutch at all,—as a matter of fact they never eve! 
The other three sections were taught the borrowing devic 
varying conditions which will be described below. 

Four independent but parallel experiments were set u] 
third grades selected from all those available in the white 
Charlotte, Greensboro, Raleigh, and Winston-Salem, Nort 





BORROWING IN SUBTRACTION $17 


i» of four teachers for each city chose their own codérdinator 


ereed upon a schedule which kept their four classes within two days 


ther in the program of instruction and measurement. The 
f difference in time among the four cities was approximately a 
nd this margin was maintained steadily throughout the experi- 


ils in the four experimental groups (the class enrollment by 

from 127 to 138, with a total of 590 pupils) were given an 
test and an arithmetic Pretest to measure ability in the ad- 
non-borrowing subtraction skills which had already been 


¢ the Pretest, given in all sixteen classes between November 
38, the process of borrowing was introduced,—in the NC- 
y the usual rule-of-thumb procedure; in the three crutch sections 
nations based upon use of the borrowing device. In all twelve 
asses the teachers insisted that every pupil employ the device on 
traction example which involved borrowing. A sample daily 
s collected from all pupils about December 7, to ascertain the 
ch the device actually was being used. About December 17, 
nonth after borrowing had been introduced, Test I was given 
vay as to furnish measures of (1) rate of work, (2) accuracy 
}) use or non-use of the crutch in borrowing examples. 
time instruction for the three crutch sections (or the twelve 
es) was changed. In one crutch class in each city teachers 
equire use of the crutch in all daily work; hence this class 
ted the R-elass, and the three such classes together, the R 
In another crutch class in each city (the D-class), further use 
rutch was denied or forbidden. In the third crutch class (the 
e short form of borrowing without the crutch was shown, and 
nh were given an option as to whether they should adopt it or 
tinue use of the crutch. 
two weeks later, daily lesson papers were again collected to 
the extent of crutch use; and two weeks later again, Test II 
stered. This test was similar in design to Test I and was 
vield comparable measures of rate, accuracy, and use or non- 
rrowing device. 
ministration of Test II on about January 14 concluded the 
proper. The children by this time had completed the text- 
‘devoted to subtraction and had begun the study of multi- 
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plication. On about January 28, after two weeks during whic 
little practice on subtraction had been offered and during which ; 


all was said about the erutch, a third test was administered ; 


pupils. Test III consisted of three parts. In Part I the twel 


traction examples all called for borrowing from the tens’ figur 
the only kind of borrowing as yet taught), and these examp| 
solved with no statement from the teacher as to whether the dey 
be used. Part 2 contained twelve similar examples, but the 
forbade use of the crutch to all children. Part 3 also consisted 
examples, but examples of unfamiliar types: the first six in 
rowing from the hundreds’ figures, and the last six, borrowing 
the tens’ and the hundreds’ figures. 

Test IV, comprising twenty-four subtraction examples, 
only to the pupils of R-, D-, and O-sections. Its purpose was | 
discover what had happened in the intervening two months a 


whether the erutch children still relied upon the device 


added that throughout the experiment all 
s studied precisely the same arithmetical content and t 
he same directions. In administering non¢ 
art 2 of Test III, did the teachers say anything at 
If crutch children inquired whether they she 


their questions were skillfully parried. 


THE FINDINGS 
re to reproduce the nineteen tables ar 
ive results of the experiment 
only summary statements will 
interested reader will consult 1 
lata had been tabulated it beeame « 
periments could not be treated separate! 
city had been earefully selected on the advice 
| supervisor to insure rough equivalence of econo! 
nd quality of pupil material. Nevertheless, large diffe 
| among the f * classes of most of the cities, and it was 


uD composite ‘tions of NC-, R-, D-, and O-children 


nol dn Yr ( lass¢ S ot ‘ eh eityv contributed va ‘ving numi 


»\ 


this procedure the original population of 590 was 1 


hi 
I 


$19, with about 100 in each experime ntal section. 





BORROWING IN SUBTRACTION $19 


ir composite sections ranged in mean I.Q. between 102.2 and 
shest mean being in the NC-section) and in mean M.A. be- 
1.2 and 9-3.1. On the Pretest, the means for accuracy lay between 
17.3, the poorest score being made by the 0-pupils. None of the 
ere reliable. As to rate of work, the medians (instead of 

were identical for all four sections. 
ndings obtained from the series of tests and from other data 
y recorded by teachers in logs may best be considered under 
ds: 1. Effeet of the crutch on skill in borrowing; 2. Perma- 


the erutch, and 3. Supplementary findings. 


crutch on skill in borrowing. 

a) On Test I all three eruteh sections secured higher 
rrect answers than did the NC-children,—the means being 
R and D, 12.0 for O, and 10.9 for NC. Two of the differ 
were reliable, the eritieal ratio being 4.7 for R-NC and 
t for O- NC was 1.8.5 
st II, given after differences in instruction on the erutech 


S 


tituted for Sections R, D, and O, the mean scores were: 
13.6: D, 12.9: O, 11.8. In other words, two of the eruteh 
still superior to Section NC, though only the difference in 

en R and NC was reliable. Apparently, then, the crutch ac- 
d pupils to get correct answers from the start (Test I), and 
for Section O) the advantage remained in favor of the erutch 

some time (Test II 

lest III, given a full school month after the first instruction 


the mean scores on the three parts were as follows: 


Part 1 Part 2 Part 3 


ection N{ 10.3 9 9 
Section R 10.5 10.0 
Section D 10.6 10.3 


Section O 9 4 R89 


liffereneces in means involving Section O were reliable. The 


f the other differences and the inconsistency of the advantage 


f Test I, it will be recalled, all three crutch sec 
’ »} +} ] } , 


t ence heoreticallyv the reater superiorit. 


of Section O over NC is a bit diffi 
+} aa 


as compared with that 

ficult to explain if 

spite of the attempt to equa 
ss capable in arithmetic 
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therein among the sections probably together mean that by the t; 
Test III the NC-children had acquired the skills sufficiently well to x 
as many correct answers as were obtained by the crutch children 
The uniform advantage in favor of the crutch children o1 
seemed to offer fertile ground for further analyses. Accordingly; 
records of the NC-children on this test were compared with the 
sponding records of an equal number (121) of crutch children s 
from all three erutch sections, in such a way that the NC-sectio1 
new composite section of crutch children were equivalent in averag 


M.A., and rate and accuracy scores on the Pretest. Comparisons reveld 


d) The erutch children secured fewer incorrect answers or 


not only for the borrowing examples but also for the non-borrowing « 


amples. The ratios of errors for crutch and NC-children were 1.8 
‘) 
here that, confronted by the unintelligible task of borrowing ir 
traction, the NC-children actually lost command over a skill (subt 
without borrowing) which they had supposedly mastered. This 
tion is borne out by other data to be presented shortly (paragra 
(e) The erutch helped not only children with low 1.Q.’s 

but also children with high I.Q.’s (above 113). Both high [.Q 
I.Q. children who used the crutch were superior to high [.Q. an: 
children who did not use it, and were superior both on borrowing 
non-borrowing examples 

(f) The same kind of finding resulted when children were 
the basis of their accuracy scores on the Pretest: both the mor 
the less able pupils profited from the use of the crutch. 
The NC-children failed to borrow 234 times when t! 


cr 
1 
i 


have borrowed, as compared with 11 times for the crutch child 
over, the NC-children made a total of 168 combination errors as | 
with 98 for the crutch children. Their uncertainty about the 
borrowing apparently had spread so as to influence their cont 
facts they had learned and over a kind of subtraction whic 
previously seemed to be able to deal with. 

Rate h) On Test I the NC-children worked no more raj 
did the crutch children, in spite of the fact that the latter childret 
been trained to write out their procedure. This rather surprising * 
seems to mean that at this stage in learning the thought processes 





2.3: 1, respectively, for the two types of example. There is a suggestix 
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hildren were as slow and cumbersome without the crutch as were 
f the eruteh children. 

On Test II Sections D and NC worked more rapidly than did 
ons R and O. By the time of Test III, however, the R-children had 
etty generally given up the crutch, and so their rate records were about 
equ 11 of those of Sections NC and D. The rate scores of Section O 
mn xplicable except on the basis of one or both of two assumptions: 
t these children were generally inferior (as has been already sug- 
and (2) that, not being told whether to diseard or to retain the 
hey were uncertain which to do and so tended to work both more 

ind more inaccurately. 


‘ith regard to rate, then, it can be said that use of the crutch did not 
iz lren who were taught it; they subtracted as rapidly as did 
e NC-children, both at first when the NC-children were fumbling about 


the new process of borrowing and later when they (the crutch 
had disearded the device. 


nanence of crutch 
s of interest to know how firmly the erutch fastened itself upon its 
Devices like the borrowing device here studied are rather generally 
| in the belief that, once they have been taught, they can hardly 
rooted and that they will almost certainly be retained to the dis- 
tage of the users. The data collected with regard to permanence of 
ch are perhaps best considered in terms of the three sections,- 
nd O. 
On Test I, 93.8 pereent of the R-children used the crutch in at 
example. Also, the device appeared as a whole or as a reduced 
t in 86.6 percent of the examples. On Test II, the teachers in the 
ving insisted upon use of the crutch in all written work, the 
nding percents were 87.4 and 88.6. On Part 1 of Test III the 
ts were 62.3 and 61.9, respectively; and on Test IV, the crutch 
lin only 12.9 percent of the examples to which it was adapted. 
The D-children were forbidden use of the crutch after Test I. 
i Test I 99.1 percent of them used the device on 93.3 percent of the 
examples. On Test II these percents were 0.9 and 0.1, respec- 
don Part 1 of Test III, 0.0 percent and 0.0 percent. On Test IV 
ce was used with 1.3 percent of the examples. 
As previously pointed out, the records for the O-children are 
is. The percents of children using the device and the percents 
mples on which the erutch was used were as follows: Test I, 93.7 
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and 87.3; Test II, 19.0 and 18.5; Test III (Part 1), 13.6 
Test IV the crutch was used with 6.0 percent of the examples 
From these statements it appears clear that if use of the ery i 
consistently opposed, the device quickly disappears or rapidly 
the vanishing point (Section D); that if its use is required, 
1] 


dren W nevertheless insist on abandoning it (Section R 


given permission to discard the device, children will abandon it in s! , 
growing numbers (Section OQ). It also is clear from these 
some children (a relatively small number) will continue to 
erutch long after it would seem to have lost any large amou 
ilness 
m) No data were collected which reveal why certain child 


gave up the crutch and why others retained it unduly long. N 


tion could be found in term of C.A., M.A., 1.Q. or initial abilit 
metic. The explanation probably lies in traits which are essent ; 
rithmetical, such as relative independence or docility, relat 
ness and originality or want of the same, ete 
K 
Supplementary findings 
Teachers, even those to whom the erutch was new t 


Imous Wit! respect to ease of teaching it and with respect 





r understanding into a process which heretofore | 


asa 6S 


tively uninte lligible. 


oO A rn imber ot ehildren who eventua ly Surrel cde re 


rly showed difficulty in so doing. Their daily pape 


papers revealed various intermediate and shortened forms 
iy fore lt disa ¢ ared compl i¢ ly. The se SUCCESSIVE Ite rations 8 Ss 
inal form are, in the w riter’s opinio! . best i terprete das furt 
he contribution made by the device. That is to say, the 
could not give up the device all at onee probably argues m2 
nd of help which is usually withheld é 
| The erutceh, once it had been given up In eonnect l 
miliar kinds of examples (in which a ten had to be borrowed b 
vholly gone. Rather. it remained available for cases of emet 
it was revived and put to work. Certain illustrations of 4 
were found 1) After a long period of non-practice, chil 
their skill in borrowing by using the device a few times 
it aside again 2) When they encountered more difficult | 0: 


rowing (as in Parts 2 and 3 of Test II), they employed the 
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of subtraction (as in problem solving and in ‘‘long’’ division), 
‘k on the erutch as a means of holding steady one aspect of 
which otherwise bristled with sources of confusion. 


’ 


SIGNIFICANCE OF THE FINDINGS 

legree of significance which the reader will attach to the findings 

s study will vary fundamentally with his conception of the purposes 

metie instruction and with his conception of the nature of the 

process in general. When the purposes of school arithmetic are 

the development of ‘‘efficient’’ skills—mechaniecal tricks for 

ting figures quickly and correctly ; and when learning is viewed 

of giving the desired skills at once to children and then of 

practice the attainment of the desired proficiency,—when con- 

ke these are held to, then the findings of the study are less than 

y are distinctly subversive. They seem to offer support for a 

struction which cannot but interfere with the most ‘‘econom 
ning on the part of school children. 


either the purposes of arithmetic instruction nor the nature of 


process need be conceived in these terms. When, to skill in 
as a purpose for arithmetic instruction, is added a second 
mely, that children shall see sense in what they learn, and 
ng process is viewed as consisting in a series of behavior 
rise from beginners’ first rather ineffectual but (to them 


ent peritorm- 
I 


is to the final stage of adult-like and intellig 


these conditions the findings of this study will be regarded 


Wing device would be opposed on a priori grounds by those 
arithmetic primarily in terms of skill and of learning pri 


terms of repetitive practice. Obviously, we do not want chil- 
‘to use the crutch in borrowing; its use, even initially, inter 
economy’’ of effort; then, once it has been learned, it must 
1; and the whole process, it would be argued, is at best futile, 
rst harmful and wasteful. Confronted by the experimental evi- 


s study, namely, that the crutch did not interfere with cor- 


‘work (even added to it) nor with rapidity of work (except at 
vhen probably it should have been abandoned ), the op 


‘ 
| IO pe 


would probably still insist that the device should 1 
ich the erutech is to take children off the straight course of 
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learning, to encourage them to develop a habit which they must ¢ 
break,—and the evidence shows that not all the experimental ¢hj = 
succeeded in breaking the habit. 

To the writer at least this last kind of thinking is unacceptal 
him it seems stultifying and futile and even dangerous. There is 
in this thinking the notion that our knowledge about learning js 
complete enough to determine by purely deductive means what is a ¢ 
and what is a bad learning device or practice. Such complacency is }; 





calculated to yield fertile suggestions and new ideas for the improve: 


of instruction nor yet to encourage research on learning as such. T! 


of worth in an educational practice is not whether it conforms, 


rn 


= 


made consistent with, what is now accepted as valid learning 


rather, the test is, does it foster sound learning? In the presen 


the borrowing device seemed to meet the test and accordingly it is n 
mended in the teaching of borrowing. 

Still, one can hardly justify the space in this article (to say 
of the space in the original monograph) if the only purpose is | 





a particular device in teaching subtraction. There is howev 
justification. The borrowing device should be regarded as 


many other devices as yet not accepted and perhaps not ever 


which, when discovered and put to work, will make learning eas er to 
more meaningful to children. This facilitation of learning is the bw st 
responsibility of research workers in the psychology of the school s es 
jects, If the meeting of this responsibility requires the abando 

much that has passed as learning theory, then false learning theory s [yp 
be cheerfully discarded in the assurance that a sounder theory . ppr 


found to take its place. 











MUSt ell pw INCIDENCE OF LEARNING FOR THE FUNDAMENTALS 


a Colin OF ARITHMETIC? 
eptable Guy M. WILson 
a i Boston University 
oe te Editor’s note: The subject of school grades has been of perennial 
Py interest. The author of this paper has raised a number of pertinent 
U 1S a guy questions relative to grading practices in arithmetic and proposes that 
v ishoveia the percent of pupils attaining a perfect score be used instead of the 
— a mmonly used mean or median. 
1. The tag Tur word incidence, as used in the title to this paper means an index 
, Or can indicator. In the past the incidence of learning may have been any of 
1g theory e following: 
a ” |. The passing grade—commonly 75 percent. 
aces 2 The norm—usually an average on a standardized test secured 
from a fairly wide testing program. 
uy nothing . The percentile rank. 
to sponse 4. The grade attainment. 
er furhelii This is not a complete list. It does not, e.g., include the well-known 
typical GiMeCall T Score, so mystifying to the average teacher. The passing grade 
en know ibtless oeeupies three-fourths to seven-eighths of the field the country 
easier an er today. The other indexes listed above are a result of the application 
; the bas statisties to the field of examining, grading, and promotion. In general, 
choo! si ese various indexes are interchangeable; that is, any one can be trans- 
onment ted into any of the others. 
ory show 'ypes of Subject-Matter, Types of Teaching, Types of Testing? It is 
ry wil kiPpropriate to ask what should determine the incidence of learning in 
iby particular ease. Are there types among which there may be different 


rds? Obviously there are, and this would easily be conceded in 

Bis group if applied to different subjects. Doubtless, anyone here would 

ree that any attempt to check or measure in the field of history would 

very different from what it is if one were measuring handwriting or 
belling or the fundamentals of Arithmetic. 

If it is conceded that there are different types of subject matter as 
hong different subjects, then doubtless there are some who would con- 
ie that there are different types of subject matter in almost any field 
bd therefore in the field of arithmetic. Specifically, it is probable that 
eryone here would insist that a sixth- or eighth-grade pupil should know 
‘A paper read before the American Education Research Association at their 

meeting in Cleveland, February 25, 1939. 
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the 100 multiplication facts perfectly and should be able to use them 
matically in examples. It is also probable that no one here would jnsie * ie 
that a sixth-grade pupil should be required to know perfectly a ta mr 
Troy Weight or a table of Apothecary Weight, with real underst 
of the meanings involved. These were at one time expectations | 
schools, but studies of usage have modified this requirement. It js 
sidered sufficient today that the child knows where to find thes 
they are needed. ‘ 

In other words, in the field of arithmetic there are varying type wh 
of subject matter. Some of these are essential drill and requir 
mastery because they constitute the much used processes in a sub 
enters regularly into the transactions of daily life and busir 
ciently to justify perfect mastery. The four fundamental processes 
arithmetic are generally conceded to make up fully ninety pere 
ordinary adult figuring. They constitute, therefore, the first | 
tion in a drill program for perfect mastery. 

It is possible that the inclusion of useless items in tests i 

has had much to do with the acceptance of low averages as a has \ 
passing. If an arithmetic test included among its items 50 p 
relatively useless or non-drill material, as do the arithmetic s 
some achievement seales today, then a 50 percent mark should be 
If 25 percent of the items are useless, then a 75 percent grade s! It 1 
passing. But if all the useless or strictly non-drill items are on 
if the test is administered at the right grade level, then, may we as 
should be the expected score? Does any one doubt the desirabilit; 
perfect score in simple tests in addition and subtraction at the sixth-¢ 


level? The making of poor tests in strictly drill subjects has 


been facilitated by the statistical fallacy, that all tests should 
some items so difficult that no pupil ean make a perfect score. This ! 
should be recognized. Relatively useless items should be omitted 
drill tests. 

Just one word further on this point. There are different types 
jects. Three types are generally recognized, drill, problem, a 
ciation. The fundamental purposes in these types are different 
not the testing be different? Drill type testing in problem and 
tion subjects is detrimental. Yet few, if any, standardized tests 
other than drill types of testing. 

It is well to recognize that some subjects contain no essentia 


; 


terials. It is also well to recognize that any subject that con 
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| drill, also contains appreciation opportunities and may contain 
} opportunities. Now if we also recognize that non-drill items 


nrobien 


t be tested with drill-type tests even in subjects where there is 
ll, then we will have arrived at a point where we recognize at 
possibility of limiting drill type testing to essential drill items 
we apply proper criteria to drill, and retain only the items 
ese criteria, we arrive at the possibility of an entirely new 


What are proper drill criteria? 
t, the material must be much used in daily living or it is not 
ll material. 
Second, no attempt at mastery should be made until after clear 
lerstanding of meaning and adequate motivation. 
the load must be small enough that mastery is easily 
ssible. 
\nd the fourth item follows logically, viz., in essential drill only 
erfect scores are acceptable. 
Now may we ask, instead of including improper items in a test and 
w standards, would it not be better to omit the improper 
do this, is there not the possibility of new standards in line 
ll eriteria just noted? 
It will be well to consider this question somewhat in detail. In the 
t should be recognized that a passing grade somewhere around 
still prevails in most schools. In the second place it will be 
to consider the meaning of norm or grade attainment or per- 
and whether or not these can be expressed in terms of a 
similar to the old passing grade. In the third place it will be 


le to analyze the meaning of an average, norm or grade attain- 


distributing grades and noting exactly what is meant by a norm 

centage grade particularly in terms of the distribution of pupils 
ete seale running from one hundred pereent down to zero. 

s presence it may be assumed that the first two items are fully 

But eareful study of the third item, viz., the meaning in 

listributed seores, of an average or norm, convinces me that in 

ve have failed to understand the significance of these measures 

ve used so freely. 

l Significance of an Ave rage in Terms of Distributed Scores. The 

of drill criteria above indicates that the important considera- 

tly drill subject-matter, is the percentage of children making 
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no errors, or securing perfect scores. What does a particular 


aVEeTage 
mean in terms of perfect scores? that 1s, 


Here are returns from 31 different groups at the sixth-grade leye| » also the 


’ 


the Wilson Addition Process Test, in terms of the mean as average ay) ys to al 
the corresponding percentage of perfect scores. The results are rounds fmmtie tes 


off to avoid decimals. bs being 
w He 
Percentage of Percentage of 
Mean 3 : . Mean 4 \ ~ F 
(Addition Process A my one 7 (Addition Process ont ertect SCor J 
fet, Ch Grade) SOOO So Test, 6th Grade) ‘+° ‘tems all correct sn wit 
score 100%) score 1 ONC iit 
99 (99.34) a9 ga 13 mlete thi 
99 (98.70) 74 88 10 2 
96 (95.60) 44 88 9 helps In 
06 25 87 1 — 
96 19 87 14 Wha 
v2 27 87 12 ; 
92 7 84 12 not 
90 19 82 { . 
90 14 80 24 or engnt; 
RaQ 17 RO . 
88 18 76 3 Tay 
RR 18 76 { . 
88 17 72 7 
88 16 72 ) 
88 14 52 ( means 0 
88 14 f 
Bixth g 
This small exhibit of means and corresponding percentage of The 
scores will be clearer from a study of the following distributio: 
It is evident, however, that a high average such as 96, may signifiy rela Suy si 
tively few perfect scores, and that a mean as high as 80 may indicat xth gr 
perfect scores, i.e., every pupil making errors on this simple test periect 
The Wilson Addition Process Test. As a basis for continuing th: | 
cussion let us direct attention to the test used as a basis for the abo ese we 
tabulation. The Wilson Process Test in addition is as simple as ? peree 
usage. The most difficult example has only six two-place addends. \ ue Poss 
*,° . . ‘ ' . . ’ - he most 
addition fact is needed above 39 + 9. Every item is reasonable. 5 ” 
items are merely primary facts. Here, then, is a test so simple t yous 
one will deny that perfect mastery is a reasonable expectation in grat Addition 
six or above. Additions in non-drill fractions, denominate numbers aay 
decimals do not oceur. — 
. ° 2 ° , 99 22 
Furthermore the test consists of a total of twenty-five examples. 4 . 
° > 1 : Rost 
of the one hundred primary facts are covered and over one huna ; 
« *,* —_ < eve 
the upper decade facts are covered. All of the common additior e 
Se - : ‘ , . . . y perce 
difficulties appear. Obviously this simple test is adequate for a reas 
able checking of pupil mastery, or a diagnosis of pupil difficulties hse 


What Time Allowance on a Simple Drill Test in Addition? Then 
question is how much time should be allowed for the test. Should pup 
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he permitted to complete the test in order that we may see what they do, 

hot is, should the time be permitted to run on as needed in order to get 

leo the diagnostie value out of the time taken for the test? If the purpose 

aid in teaching, evidently the pupil must be permitted to complete 

he test, especially in consideration of its simplicity, and the fact that it 

's being given in one of the upper grades. In a sixth grade in a sizable 

New Hampshire city, the time ran from four minutes to twenty minutes. 

In the sixth grade in fifteen cities in the Boston area the time ran from 

minute to twenty-five minutes. A very small percentage did not com- 

the work in twenty-five minutes, nearly two percent. The time taken 
diagnosis of pupil needs. 

Score? From the standpoint of the average score it may be 

‘he New Hampshire city referred to above had a median score 

in the sixth grade and a mean score of 78.8. This score compares 

with the usual 75 percent passing. It is, however, a little low 

} irison with other cities. For fifteen cities in the Boston area the 

eans on this test run as follows: fourth grade, 65.36; fifth grade, 80.88 ; 

rade, 87.96; seventh grade, 88.65; eighth grade, 89.83. 


ont 


Meaning of an Average. These averages seem unusually satis- 
vet they are not satisfactory, as a careful spread of data will 
The New Hampshire city with a median of eighty in the 
showed six perfect scores out of 170—less than four percent 
The fifteen towns and cities in the Boston area showed from 
nineteen pereent perfect scores at the sixth grade level. That is, 
ese were the results in fourteen cities. In one city; city 0, there were 
percent of the children showing perfect scores and this again suggests 
e possibility of entirely new standards. Using, as a basis for thinking, 
the most favored situations among my codéperators for the last four or 
years, we may note mean scores for grades four to eight on the Wilson 
m Process Test as follows: grade four, 98.00; grade five, 99.10; 
six, 99.34; grade seven, 99.58: grade eight, 99.86; and still the 
juestion is what do these scores mean. In the case of the sixth grade mean 
{ 99.34, we have the one eity, City O, noted above, among the fifteen in 
the Boston area where the perfect scores equalled 89 percent. The other 
percent of seores for City O, were distributed as follows: at 96, 

nt; at 92,2 pereent; at 88, 2 percent. 
her words a mean score of 99.34 in this case means that there were 

ven percent of children not perfect. 

nean score of 99.34 can mean that there were still eleven percent 
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of the children not attaining perfect scores, what does a mean s 
75 or 80, or 85 signify? We have noted that the mean of 78.08 j; 
Hampshire city meant that about four percent of the children had 
scores. Furthermore in that city about eight percent had a scor 
about twelve percent a score of 92, and the scores continued dow 
where four percent of the pupils registered. 
Taking one of the more favorable of the fifteen cities in th 
W.P.A. study in the Boston area? (or rather fourteen cities 
City O, the exception to the rule as noted above), City E had 
of 92 percent. The mean was 89.42. These scores appear to be ver 
able. They are, as compared with the 75 percent average. D 
the scores, however, we note that: 17 percent fell at 100, 22 ; 
at 96, 18 percent fell at 92, 15 percent fell at 88, 9 percent 
8 percent fell at 80, and on down through 76, 72, 68, 64, 56, 48, 
to zero. In other words a mean of 89.42 indicated only 17 percent | 
scores. 
Taking other averages, we may note that a mean of 87.93 sl 
eent perfect scores. Another mean of 89.91 shows 19 percent 
scores. Time and again the scores run down as low as 56. Som 
similar implications are presented in an article scheduled for 
number of the Mathematics Teacher. 
Distributing the Scores. The obvious point to the above is 1 
score or any kind of an average or norm taken alone requires v 
interpretation. The most obvious method of interpretation Is t 
the scores along the entire scale and if we are interested in 
diagnosis it evidently means that the distribution should ine!l 
child, not only score but time. This two-way distribution based 
and time will facilitate an interpretation and will help decided 
the conclusion that in a test so simple as the one under conside! 
with a time that is not limited, the pupils at the sixth-grad 
above should show perfect scores or their work is not satisfactor 
From among hundreds of tables showing two-way distri! 
seore and time on the Wilson Addition Process Test, a few ty] 
are here presented. 
Table I shows a two-way distribution, score and time, 01 
26 sixth-grade children in one of the better school systems in 1 
*See Yearbook of the American Educational Research Associatio 


* Wilson, Guy M., and Hanley, Gertrude L. ‘‘For Basie Drill 
What Norm or Average Is Satisfactory?’’ The Mathematics Teache 
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. It will be noticed that there are no perfect scores although the 
ba score is 72. This is one of the poorer of the six sixth-grade rooms 
ling. In Table II, it will be noticed that eighteen percent of 
es fall at one hundred, ten percent at ninety-six, and that the low 
s seventy-two. This is one of the better sixth grades in this build- 
median is 88. It shows results that are typical for the better 

| schools throughout the country.* 
study of Tables I and IT will help one to realize that we have 


TABLE I 


Score AND TIME ON A. P. TEST MADE ON INITIAL TES 
BY Room N. SrxtTH GRADE, OCTOBER, 1938 


Time in Minutes Total Percent 
7 8 ) l 11 12 13 14 15 16 23 
1 2 7.68 
1 1 1 t 15.36 
l 1 3.84 
l I 4 15.3¢ 
1 l d 7.68 
y 4 l 11.52 
l ] 1 11.52 
l 1 +84 
| l 2 7.68 
l l 2 7.68 
l l s4 
l R4 
a 1 7 l 2 4 l l l l 2¢ 184 


S ) ee Ame Ma 
| \" q ( ‘ 10 ~ 
I } Minute I 4 Pe nt 
8 ’ l 11 pu ! 14 I 
l l l 1 18 
1 10.8 
l l 61 
] 2 9 21.66 
l 1 l l S 
2 ] 10.8 
1 1 4 14.44 
] 1 2 7.22 


ren even in the most fundamental drill material to go 
scarcely the semblance of mastery. Such results in addition 
? 


olerated in any business. For all practical purposes, there 


+l and IT are due to the ecodperation of Florence Ridlon, Graduate student. 
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fore, they are worthless. The time spent has been wasted, probably wo 
than wasted since it has built up aversions that keep these children y 
manently insulated from arithmetic. 

Two other tables are inserted here for comparison.’ These come }) 
another school. Table III shows the results on the Wilson Ad 
Process Test in a sixth grade in September. No child made a pe 
score, although the median is 84, and the mean 82.4. In the m 
however, the teacher had taken courses in the teaching of arithmetic. %. 
had developed the concept of better work, and determined to remedy ty 
situation. 

Table IV shows the results of using the same test over, 
form) three months later, (December), with the same sixth grad 
IV thus shows the results on the same test after three months 
work. The mean rises from 82.4 to 95.6. Approximately 50 per 
the scores are perfect. Table V shows results of March testing 
Division by another specially trained teacher.* 

Under all the circumstances, what should be the incidence 
in the fundamentals of arithmetic that will be most helpful? 

The incidence of learning that is proposed is the percentag 
pupils with perfect scores, not the mean or median or some nort 
attainment based upon one of these, but the percentage of perf 
even though the mean may run as high as 99.34. This high averag 


TABLE III 


DISTRIBUTION OF SCORES AND TIME ON THE A. P. TE 
SrxtH GRADE, SEPTEMBER 7, 1938 


Scores Time in Minutes 
> 12 13 14 15 If 18 19 20 27 28 71 

10 

6 l l i 

92 2 l 1 l 
88 I 2 l l 

R84 2 | ] l 

Ri 1 l 

76 l l 1 I l 1 

72 I l 

68 l l 

64 

t 

56 1 
Totals } 3 2 8B ; ae. 1 1 2 1 1 I 1 
Median Scoré R4 
Mean of Score 82.4 
& Perfect 00 


Kindness of Mary Kett, Needham, Massachusetts. 
* Kindness of L. K. Houghton, Jr., Wayland, Massachusetts. 
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TABLE IV 


TION OF SCORES AND TIME ON THE A. P. TEST 
SrtxtTH GRADE, DECEMBER 9, 1938 


Time in Minutes Totals Percent 
Ni 7 8 9 10 11 12 13 14 15 16 
2 2 1 1 Pe 1 16 49 
l p 2 7 21 
2 1 4 12 
I 2 3 ) 
| 1 1 3 9g 
als i 4 9 2 3 2 1 33 1 
18.4 
TABLE V 
IBUTION OF SCORES AND TIME ON THE 8. D. P. TEs 
EIGHTH GRADE—A RE-TEST, Marcu 
5 Time in Minutes Totals Percent 
2 4 5 t 7 & 9 
1 4 ) 3 5 2 1 1 2 5. 
1 1 4.4 
T l 5 5 ; ) 2 1 1 2 1 { 
\ A f res 99.83 
95 + 


still left 11 percent of the pupils with scores of less than 100. 
ge of scores not reaching 100 percent, becomes the significant 
It indicates the task ahead. A mean of 99.34 is not satisfactory if 
Nor is a 


The only aceeptable mean for a group of 


11 pereent of the children without perfect scores. 
JIS satisfactory. 
children in a simple test in a fundamental process is the 

e hundred 
should be no hesitaney in aecepting the percentage of scores at 
rrect incidence of learning in simple drill material such as 
If the 
the curriculum is right, and if the teaching is right, the 
The 
posed incidence is more discriminating if eomparisons of 
and it 


the fundamentals of arithmetic in whole numbers. 
simple useful drill is possible for any normal child 


ties are wanted; it leads to more fruitful diagnosis: 


enge to the highest grade of teaching. 
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Kditor’s note: Persons who secured their basic training in statistia | 

some years ago may or may not have kept up to date. The author presen: mi 

a discussion of an important development in this area. — 

In order that there be no misapprehension as to the content of i ~ 

paper, let me state now that nothing new will be presented, no kul ae 

edge of higher mathematics assumed, or complex formulas develop os q 

This paper is designed to serve a far humbler purpose in the gene , i 

scheme of educational and psychological research. . 

The development of statistical techniques and the growt! ay 

number of applications during the past five decades might be regar ia 
as something similar to a geometric progression. In view of t } 


mendous development and growth, it is not at all astounding that 
able techniques should be overlooked. It is the purpose of this papr gi... .. 
remind you of one of such technique, the analysis of variance : 
hope that you will consider the method in the light of your own spect 


problems. There can be no question that analysis of variance is snede 
tremely powerful method, but it remains for research workers t ds 
applieations to their problems for the method to spring into promin ly 
A few simple applications will be presented to titillate your int * 
this tool. e ] 


Experiments are often designed to test the ‘‘null hypothesis’ 
is, the hypothesis that there is no population difference in the varie! 
under consideration. Essentially this is what is done when a differ 
hetween two means is determined, the standard error of the differs 
computed, and the difference tested to see whether it is signi 
different from zero. However, it should be remembered that it Is ne 
possible to prove a null hypothesis. 

Analysis of variance is a technique developed by R. A. Fisher f 
regating from comparable groups of data the variability assig 
to different known sources. Actually it is a method for arranging &* 
metical faets so as to isolate into two or more parts the variation 
able to each specified source. This segregation of the variation attri! 
to specifie causes makes it possible to apply either Fisher’s z-test, °° n eval 
more readily applied F-test of Snedecor for detecting significa’ 
ferences among the sub-groups within a set of data. Another 


434 
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re of so arranging the data is the provision for the estimation of 
tal error independent of the variabilities whose sources are 
issignable. 

ever the use, the arithmetic involved is simple. In its simplest 
e method involves three quantities, the total sum of the squares, 
f the squares within classes, and the sum of the squares between 
total sum of the squares consists of the squared deviations of 
lividual about the general mean. The sum of squares within classes 
sists of the squared deviations of the individuals from their group 
ns. The sum of the squares between classes is the difference between 
In practice, for computational purposes only, one reverses 
first securing the total sum of squares. Then one determines 
squares between means of classes around the general mean 

¢ each mean by the class frequency. 
lisecovery by Fisher of the distribution of ratios of these sums 
res makes possible, the test, for significance of the dispersion 
lass means with the dispersion to be expected on account of ran- 
sampling. A more convenient form of Fisher’s z-test of these ratios 


Larger mean square 


or’s modification, namely, F Efficient 


Smaller mean square’ 
ls in the design of experiments and the use of techniques such as 
ysis of variance should bring about substantial reduction in the 
nd cost of experiments. 
method of analysis of variance rests on two points: (a) the 
e character of sums of squares, and (b) the assumption that the 
ler consideration is normally distributed in the population 
In practice, considerable leeway is allowed in departure from 
y, but obviously this imposes restrictions on the interpretation 
results. With these preliminary remarks as a stage, or perhaps 
| barrage to cover the paucity of examples, consider the follow- 
tions of analysis of variance: 
limitation of the services of the statistician in a school system 
lies of pupil aecounting, educational status, and test construction 
ys seemed to the writer an undue prescription of the statis- 
services. Bureaus set up for testing school supplies, schoo! 
nd so forth, should avail themselves of the statistician’s tools 
ting the efficiency of materials and methods. Consider the fol 
¢ hypothetical example: Complaint had been registered by the 
rs in city A concerning the chalk used in the classrooms to the 
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effect that it was too hard and contained an undue amount of grit. 7; 
Bureau of Standards found variations in hardness among the commens 
chalks of several companies, but the question remained as to whety 
these variations might be attributable to sampling errors. Five sis 
selected at random from each of a dozen boxes of a given brand ; 
chased in a variety of stores over a period of time furnished sample 
each brand. Seven brands were under consideration, the schematic ans) 
sis of which is given in Table I. 


TABLE I 


ANALYSIS OF BRANDS OF CHALK FOR HARDNESS 


Mean Square 


Source of Variation Degrees of - —- _ d 
Freedom Situation A Situation} cx 
Total 419 120 ore 
Brands : 6 60 | 
Boxes of same brand 77 40 — 
Crayons from same box... . és 336 20 : = 
Two possible situations or sets of results are indicated in Tal ' 
Both of these are fictitious, and it should be pointed out that, in practie ame! 
one does not get such convenient even numbers. 
A few comments on the various degrees of freedom given in the tab 
might be helpful. Since there are seven brands, twelve boxes of ‘ a 
brand, and five samples taken from each box, the total number of era) 
is 420. One degree of freedom is lost due to the use of the mean in gett . 
the sum of squares, so that there are only 419 degrees of freedom pun ment 
the study of the seven brands, again one degree is lost, so that only e 
remain. In the study of boxes within brands, one degree is lost for The to 
brand, so that there are 7 X 11, or 77 degrees of freedom here. In' it 
study of crayons from the same box, we have only 4 degrees of freedom een 1 
each box, so that the total is 4 X 12 X 7 or 336 degrees. un hi 
Under situation A, the boxes of the same brand do not differ signi ference 
cantly, sinee 60/40 give an F value of 1.5. The boxes in the same br sent 
however, differ significantly indicating a lack of quality control in matt mn 
facture as revealed by the F ratio of 40/20 or 2.00. The 1 percent s ool 
here is 1.84. The question now arises as to whether this variation holds aepaties 


all seven brands. This requires seven analyses to be made, each as inaica'® 


in Table IT. 
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Brit. Th TABLE II 
MMereig ANALYSIS OF QUALITY VARIATION WITHIN A SPECIFIC BRAND 
Whe Degrees of 
—— Source of Variation Freedom 
- Total... 59 
. Boxes within a brand. .. ll 
my ” Crayons within a box. j ; 48 


wever, the mean squares had been as indicated under the second 
n, B, then uniform quality would have been indicated for each 
the brands would have been judged to differ significantly) 


» themselves. 
question of the relationship between high school prepara- 
ic I ve success has been reopened recently by Dressel \ 1 he To 
t do high schools differ in the grades assigned to students who 
ve, and are these diffrences reflected in their college marks? 
study is of two-fold interest, first, for the topic, and second, 
is use of the analysis of variance technique. He studied the records 
nts distributed among 15 high schools, for whom both high 
T ords and first year college averages were available. In Table 
esented the basie data from Dressel’s study. 
TABLE III 
ANALYSIS OF HIGH SCHOOL AND COLLEGE GRADES 
Sum of Squares Mean Square 
sriation Degrees of -——* 
Freedom High School College High School College 
g 809 302.41 512.30 a7 63 
gh schools i4 28.81 19.51 2.06 1.39 
795 273.60 192.79 ‘4 62 
The total sum of the squares for high-school grades is 302.41, but this 
en down into two parts, that attributable to the difference 
means of high schools, and that due to individual variation 
high schools. Now it might be postulated that there are no 
signi Terences between high schools. If this is the case, then the mean squares 


] 


ting either the variation between the means of high schools 01 
vithin high schools could be used as an estimate of the variance 

f school grades. If the null hypothesis (that either of the values may 
sed as an estimate of school grades) holds, then these values should 
uffer significantly. Now, dividing the variance between high-schoo! 
tans by the variance within high schools gives 2.06/0.34 or 6.01. En- 


ag Snedecor’s table with 14 and 795 degrees of freedom respec- 
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tively, it is found that the ratio of 2.20 corresponds to the 1 peng 
point; therefore, the differences between high school averages are hig) 
significant. Similarly, an analysis of the college grades for th = 
groups of students gives a ratio of 1.39/0.62 or 2.25. This is interpreta), 
showing that the high-school groups differ significantly in the grades » 
ceived in college. The mean square among high-school grades js 
siderably larger than the mean square among means of college gm 
for the same high-school groups. This indicates that, so far as th 
lege is concerned, there is not nearly as much difference betwe 
groups from various high schools as the high-school grades would \y 
one to expect. It is not possible to compare directly the values of? 
and 1.39 sinee there is correlation between the college and | 


grades. This brings up the problem of co-variance, a natural and higilj 


important extension of the problem, but not treated here becaus 
of time. 

Another type of problem that continually arises to plague t 
tigator is illustrated by the following: Most school populations an 
erogeneous with regard to race, and the investigator is forced to « 
whether or not the ethnological factors will disturb his results. Ano 
ever present question is whether sex differences will invalidate the res 
Dunlap (2) in a survey of the public school children in Honolu 
regard to achievement as measured by the arithmetic reasoning | 
the old Stanford Achievement Test was confronted with a series 
questions. 

The first question, namely, Is the difference between the 
races sufficient to disturb the results? might be inverted and thi 
made that there is no real difference between the means of the 1 
racial groups. The computation of the various sums of squares was 
in the usual manner and the results are shown in Table IV. 

The mean square within sex-race subclasses may be taken as 


TABLE IV 
ANALYSIS OF RACE VARIATION IN ARITHMETIC REASONIN 





Degrees of 


Source of Variation Freedom Sums of Square 
Total 3758 2.430 .025 
Between means of races 5 169 , 400 
Between means of sexes in race, one degree of , —_— 
5 71,01¢ 


freedom in each race 


2,089 ,615 








Within sex-race sub-classes 
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experimental error, so that the mean square between means of 
ded by that within races. This ratio, 38,880/557.53 is 69.73. 
needed to interpret this, for it is obvious that the means ot 
ry significantly. It can be shown in a similar fashion that 
erences within races are significant. The wide discrepancies 
ns of races are not attributable to chance and mingling of suc! 
t well distort correlational studies of such data. 
complieated problem that might be presented to the hypo 
reau of Standards mentioned above is exemplified by the 
‘an (3), quoted in Snedecor’s admirable volume (4). Dun- 


em was to determine the merits of lard as a cooking fat. Eac! 


in making four mixes of dough, and from each mix, forty 


baked. The individual cookies were then tested for break- 
The problem was to test the technique of mixing, baking 
ng the cookies, to make a valid estimate of experimental error 
termine whether the fats differed significantly in respect to 
trength of the cookies made from them. Snedecor presents the 


r analysis, Table V. 


TABLE V 
Is OF TENSILE STRENGTH OF COOKIES MADE FROM DIFFERENT FATS 


Degrees of 
f Variation Freedom § of Squares 


| be noted that the sum of the squares, 27,130, between the means 


ve mixes is not entered in the table, since it is not needed 
determine by subtraction the variance ascribable to ‘‘within 
‘his problem is comparable to the chalk problem but set up 
ferent. Note that these twelve means account for eleven degrees 
There are three fats; therefore, there are only two degrees 
tween means of fats. Since each mix mean is measured from 
mean, there are only three degrees for each fat, or a tota 
tween the means of mixes within fats. The sum of the degrees 
m between means of fats, two, and between means of mixes 
, nine, gives a total of eleven, which checks with the degrees 
m between the twelve mix means. 
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There are two striking features in the above analysis,—first the yp — 
difference between the mean square between mixes within fats and 4@ilBpys 
within mixes. This indicates a failure in technique, for the four bak ; 
from each fat differ significantly from each other. The second featyy: Jil. io: 
the tremendous mean square between fats, which, when compared 
the value 61.9 indicates that the fats are significantly different. 

Dr. Grace Rubin-Rabson (5) in a recent study of the psycho] 4 
memorizing music has used analysis of variance effectively in the inter The 
tation of her data. The nature of the problem was such that the num 
involved were of necessity small, only nine eases. The nine subjects 
divided into three groups, roughly equivalent as to training and exp 
ence. Nine compositions were employed, each group learning three op 
positions by each of the three methods. The methods, the compos 
and the order of learning were rotated so that every combinat 
method and composition was presented in every order. In order t 
this, it was necessary to arrange each of the three groups into a La 
Greek square construction, and the designs for the three g: 
turn constituted a large square, so that the varying capacities 
subjects operated equally as did the varying difficulties of the eon 
tions. The procedure involved 81 learnings, 27 by each of 
methods. 

TABLE VI 


SCHEMATIO ARRANGEMENT OF ANALYSIS OF Music DATA 


Source of Variation Degrees of Freedom 

Total 80 

Subjects . 

Methods 2 { 
(ompositions 8 ; ‘ 
Order 2 

Residual error 60 

The following example is hypothetical. It is proposed to invest e | 


the relative efficiency of teaching science by three different methos D 
(1) regular classroom instruction, (2) classroom instruction su 
mented by radio talks and questions formulated by various classe 
swered over the radio, and (3) classroom instruction supplement 
‘‘eanned’’ lectures, the ‘‘canned’’ lectures to be identical with t 
talks, but no discussion other than with the classroom instruct 
_ 


problem in its simplest form can be thought of as consisting of tw 
mental groups and one control group. Thus only three instructors 
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essary. The results, however, probably would be biased by varia- 
teacher efficiency and interest. This may be partially controlled 

each teacher give instruction under each experimental con- 
A further difficulty arises due to variation of student ability 
iss to class. This difficulty gives rise to the problem of experl- 

on, which merits extensive comment, but must be omitted for 
tual scheme of analysis of variance for such a study might wel! 


as in Table VII. 





TABLE VII 


~ SCHEMATIC ANALYSIS OF DATA ON VALUE OF RADIO TEACHING 
. Source of Variation Degrees of Freedom 
IM pos Total : N-1 
Within Classes. . N-9 
iT Bet ween means of teacher groups 2 
f Between means of method groups... .. 2 
Interaction or remainder 4 
-_ sis such as the above provides tests for most of the basic 
s arising in analyzing the results. 
loes not allow further examples, but in closing the author 
to call attention to an article by Lev (6) entitled ‘‘ Evalu- 
tion of Test Items by the Method of Analysis of Variance.’’ This is 
nexplored field for the application of this method. 
clusion, let us summarize the above. The method of analysis 
nee is not new; it is an arithmetic technique; in the case of twé 
gives exactly the same results as Fisher’s t-test for the dif- 
tween means; nevertheless it is a useful and valuable tool for 
search worker. Examples have been given to illustrate its useful- 
the analysis of causal relationships of school grades, (2) in 
ig presence or absence of heterogeneity among subjects, (3) in 
Investig ¢ testing of differences in products, (4) in establishing quality control 
} manufacturing and experimental conditions, and (5) in experi- 
8 ‘al problems of learning and test construction. 
Classes The omission of the analysis of co-variance, a logical extension of the 
mente od analysis of variance has been deliberate, since the purpose o! 
per is to emphasize areas in which the method is applicable, not 
netor. | f extensions of the method. Likewise, computation has been omitted, 


wo expe * it is simply and adequately described in Snedecor’s two volumes 











$42 



















JOURNAL OF EDUCATIONAL RESEARCH [Ke 


BIBLIOGRAPHY 


Dressel, Paul L. ‘‘The Effect of High School on College @, 
Journal of Educational Psychology, XXX, 1939. In press 
Dunlap, Jack W. ‘‘Race Differences in the Organizatio; 
merical and Verbal Abilities,’’ Archives of Psycholog 
No. 124. 
Dunean, Helen J. ‘‘ A Comparison of the Shortening Power « 
with other Fats and Oils in plain eggless Cookies and in Past; 
A Thesis submitted for the degree Master of Science 
State College, 1933. 
Snedecor, George W. Calculation and Interpretation of Ana 
Variance and Covariance, Ames, lowa: Collegiate Press, 1934 
Rubin-Rabson, Grace, ‘‘Studies in the Psychology of Mem y 
Piano Music, A Comparison of the Unilateral and the ( 
nated Approaches,’’ Journal of Educational Psycho 
1939), pp. 321-345. 
Lev, Joseph. ‘*‘ Evaluation of Test Items by the Method of Ar 
of Variance,’’ Journal of Educational Psychology, XXIX 
(1938), pp. 623-650. 
Snedecor, George W. Statistical Method. 
Press, 1938. 


lowa 





Ames, 




















THE INTELLECTUAL GROWTH OF COLLEGE 
STUDENTS 


CHARLES D. FLORY 
Lawrence College 


Editor’s note: At what age does one reach intellectual maturity? There 

some considerable difference of opinion about this matter. The 

resents data to show that college students at Lawrence College, Wis- 

nsin, make statistically significant gains in intellectual maturity during 
urs that they are in college. 


end point in intellectual development has been a controversial 
r several deeades. Early investigators were so absorbed in finding 
testing instruments that they agreed quite arbitrarily upon the 
hich individuals reach intellectual maturity. When experimental 
van to reveal conflicting results the maximum mental age was 
» or down to meet the latest body of evidence. The effort of 
rists to adjust their thinking to the experimental findings caused 
er limit of intellectual growth to be pushed all over the ‘‘teen 
th age sixteen quite widely accepted for test purposes. Recent 
as shown that intellectual growth continues through the ‘‘teen 
| likely into the twenties when there is stimulation appropriate 

turity level of the individuals concerned. 
Rogers* was one of the first investigators to show that college students 
improve in intellectual ability as measured by present-day in- 
tests. Re-tests were made on 56 seniors, 35 juniors, and 55 soph- 
Bryn Mawr College. These re-test results were compared with 
i scores on the Thorndike Intelligence Test. Analysis of 
revealed that the amount of growth was related to the length 
e student had spent in the institution. Seniors had gained 
juniors, and juniors had gained more than sophomores. Rogers 
t although the gains in intellectual ability after age eighteen 

ey were significant. 


n, Frank N., and Flory, Charles D. ‘‘Growth in Intellectual Ability as 

Repeated Tests,’’ Monographs of the Society for Research in Child De- 

', Ll, No. 2 (1937), pp. xi + 116. 

tson, L. D. ‘*Does College Training Influence Test Intelligence,’’ Journal 
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nell, T. R. ‘*Change in Scores on the Psychological Examination of the 
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Wright* found from re-test data at the University of Pennsy]yap; 
that college students had not reached intellectual maturity. He o 
cluded from his study, ‘‘Though we may not expect the complex menty 
processes to increase indefinitely, there is no evidence for an approach 
plateau at age twenty-three.’’ 

McConnell* discovered significant improvement in the test scores ¢ 





Cornell College students after four years of college training. The geo 
for 70 seniors showed a gain of more than 40 points on the America 
Council Tests when compared with the freshman scores. A critical ratiy 
of 18 plus indicates a highly significant improvement in intellectual ahi. 
ity. The women in the Cornell study gained nearly 12 points more t 
the men but the sex difference was not statistically significant, (a erit 
ratio of 1.73). MeConnell did not report the number of men and wone 
in his study. He found a correlation of .83 + .02 between freshman score 
and senior scores. 

Hartson® studied the effect of college training on the intelligen 
394 Oberlin seniors. The Ohio State University Psychological Examin. 
tion was used in the Oberlin study. The average gain was 11 percentile 
points, from 73 as freshman to 84 as seniors. A critical ratio of 7.4 ind: 
cates a significant increase. The greatest gains were made by students 1 
the lowest deciles. Many of the students in the lowest deciles dropped 
out of college before reaching the senior year but those who survived 
showed a significant group gain in intelligence. Hartson reported a ne 
ative correlation between initial scores and the amount of improvement! 
He concluded that improvement in intellectual abilities continues dunn 
the college years in those areas where stimuli are provided. Harts 
interpreted his findings as an argument against the gradual 
of abilities by maturation independent of particular training 


THE PROBLEM 


The present investigation was conducted to determine the am 
growth in intellectual abilities during the college years as reveal 
the American Council on Education Psychological Examination 


rac 


data consist of freshman and senior scores for 74 students g 
from Lawrence College in June, 1938. The freshman tests were ¢ 
* Wright, Melvin B. ‘‘The Development of Mental Ability at the Coleg’ 
Level,’’ Journal of Educational Psychology, XXII (November, 1931), pp. ©!’- 
* McConnell, op. cit. 
* Hartson, op. cit. 
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September, 1934 and the senior tests were given at the end of 
Hi e ‘nil, 1938, making an interval of about 44 months between tests. On 
17 students were given the 1933 Edition, 20 the 1934 Edition 
test they had taken four years earlier), 16 the 1935 Edition, 
, 7 e the 1937 Edition. The results were made comparable by inter- 


| scores into 1934 percentiles. Freshman and senior percentiles 


e for 36 men and 38 women. 


\mericay THE RESULTS 

its of the re-test are presented in Table I. The mean per 
for the 74 seniors was 81.3 + 1.42 in April, 1938 as com- 
72.7 + 1.62 in September, 1934. The mean difference is 8.6 = 2.15 
ts, with a critical ratio of 4.0. It can be concluded with 
t these 74 students made a significant group gain in intellectual 
ng their four years in college. The median gain (8.3 percentile 
mit equal to the mean gain, while the gains for Q, and Q, 
y smaller than the median gain. It is interesting to note that 
preentil Q and S.D. are slightly smaller in the senior year than in the fresh- 

7 . vear, although the decrease is not statistically significant. 
fact that nearly half of the students studied were above Q 
rthe 75th percentile on the national norms as freshman means that 
ssibilities for gains in percentile rank were quite limited. It is 


TABLE I 


IN INTELLECTUAL ABILITY DURING THE COLLEGE YEARS FOR 
SEVENTY-Four LAWRENCE COLLEGE STUDENTS 


Ml Variable Freshmen Seniors Differences 
M 72.7+1.62 81.3+1.42 8.6 
Qi 64.2 69.2 5.0 
Md 82.0 90.3 g 3 
Qa 91.5 95.8 4.3 
Q 13.7 13.3 0.4 
S.D 20.8 18.3 9 5 


vn that seores which fall around the middle deciles of the per 
bution are more likely to fluctuate than are the scores at the 
mes. When the 18 students who fell below 64.2 or Q,, in the fresh 


are considered alone, their gain was 17.7 percentile points as 


listr 


i to 8.6 for the total group. These 18 students had an average 
e rank of 42.6 as freshman and 60.3 as seniors. The amount and 
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direction of the changes made by the entire group of students dur: 
their college years can be seen more clearly when presented in taby) 
form. The changes found have been summarized in Table IT. 





The data in Table II show that the large majority of the stude “ 
improved in intellectual ability during the college years. Some stydo» 7 
seemed actually to have lost in intellectual competence, while othe ‘kel 

TABLE II 
THE AMOUNT AND DIRECTION OF THE CHANGE IN INTELLECTUAL Strat s 
Gains and Losses <"" "= Men ™*s. Women ~* Total reases 
40 and up.. 2 0 2 Wher 
30 to 39 2 1 3 s 1oul 
20 to 29 | 4 5 resi 
10 to 19 9 5 14 0 2 
1 to9 15 18 33 ve; 
No Change 3 2 5 r 
-ilto -9... 3 5 8 
-10 to -19 ‘ 0 1 l | 
~20 and below... . 1 2 3 - 
Total... . 86 38 74 


made no significant change. Two students gained 40 percentile | 
or from 38 to 78 and from 44 to 84, respectively. These two men wer 
low in rank as freshmen that they were hardly considered good collig 
risks, but as seniors one exceeded the mean of his class while the 


was less than four points below the mean. Twenty-four students gain: 
more than 10 percentile points, which seems to indicate a highly sigui 
cant improvement for these students. Only four students lost as mici GM not oy 
10 percentile points, while eight lost from one to nine points. i 

Sex Differences.—It appears from the data in Table IT that the! 
gains are made more often by men, and the losses are more ¢ 
among women at Lawrence College. This fact is presented more ciett 
when the gains and losses are expressed in percentage for each sex. 7 
data in Table III reveal that the men made larger gains and had ! 
losses. The reader’s attention is called to the duplication in Table! 
Four men gained 30 percentile points or more and 14 gained 10 percet" 
points or more. The 14 who gained 10 points or more include the‘ 
who gained 30 points or more. Likewise, the 29 men who made s 
gain include all men who gained whether their gain was one or # !* 
centile points. Four out of five men (81 percent) made a gain ™ 
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it of four (74 percent) of the women gained. About one out 
32 percent) of the students gained 10 or more percentile points. 
nercent of the students lost enough to make their change in 
mificant. These findings seem to indicate that at least one-third 
e College students who have the four-year college experience 

to change significantly in their intellectual status. The men 
largest gains and the greater number of gains while the 
fered the greatest losses and accounted for a larger share of the 
the sex difference for the group as a whole was considered it 
nd that the women exceeded the men in percentile rank at both 
and senior levels. The men had a percentile rank of 

253 and the women a percentile rank of 78.7 + 1.86 in the fresh- 
The difference between the men and women was 9.2 + 3.14 
points. A eritieal ratio of 2.94 indicates that this difference 


TABLE III 
PERCENTAGE OF EAcH SEX MAKING VARIOUS AMOUNTS OF CHANGE 
All 
inges Men W omen Subjects 


N Percent N Percent N Percent 


tile points or more 4 11 1 3 5 7 

tile points or more 14 39 10 26 24 32 

tile point or more 29 81 28 74 57 77 

3 Ss 2 ) 7 

e; t or more 4 ll 8 21 12 16 
ints or more... l 3 3 Ss 4 


early significant statistically, but suggests strongly that Lawrence 
men are, in their freshman year, somewhat inferior intellectually 
eshman women. In the senior year the mean percentile ranks 
+ 2.08 and 84.2 + 2.00 for men and women respectively. The 
nee at the end of the college career was 4.8 = 2.89 percentile 
favor of the women, with a critical ratio of 1.67. The men had 
| the sex difference in intellectual ability by approximately one 
four years. There is at least a possibility that the superior gain 
mong men is due to the later maturation of the male. 
men had an average gain of 9.8 + 2.94 with a critical ratio of 
le the women made an average gain of 5.4 + .86 with a critical 
' 6.26. The gain was much greater for men than for women but 
nee of the gain made by women shows that there was a real 
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improvement during the college career. The greater variability ano, 
the scores for men makes a larger probable error and therefore a sm) 
critical ratio. There were only three women below the 50th percenti};, 
freshman as compared to 10 men. In the senior year only one won, 
was below the 50th percentile as compared to seven men. The lows 
percentile rank made by a senior woman was 20 as compared to 44 iy 
the men. 

Maturation.—The five students who gained more than 30 percent 
points showed evidence of significant maturation during their colkg 
years. Four of these five students were men which lends further s 
port to the possibility that the gain was due to a maturation factor. 7) 
only woman in this group informed the writer that she reached pubescens 
somewhat later than the average and considered herself a slowly & 
veloping person. One of the men who gained 40 percentile points » 
ported that he grew 2 inches in height and gained about 25 pounds 
weight during his college career. There is evidence from his college recor 
to show that he matured significantly in social abilities as well as i 
tellectual and physical characteristics. 

Relation of original status to change.—The correlation between ty 
percentile ranks in the freshman and senior years was .82 
size of this coefficient corresponds very closely to the result (.83 
ported by MeConnell® for Cornell College students. It must be conclu’ 
that there was little shifting in rank during the college years. The 
students who were high when they entered college remained so and the 
who were low seemed to improve but failed to exceed their brighter 
colleagues. A negative correlation of —.49 + .06 between the freshma 
percentile rank and the amount of change gives additional suppor! 
the finding that those students who were low in the freshman year gain 
most. It must be recalled that one-quarter of these students were in ™ 
upper decile (Q, equals 91.5) when they entered college and thereim 
could not have gained as much as the average for the group if each @ 
of them had reached the 99th percentile in the senior year. The factt 
the best students as a rule made some gain is shown by the increase 1' 
from the freshman to the senior years. One-quarter of the seniors 
in the top four percentiles (96, 97, 98, 99) while more than half 
class was in the upper decile (Md =90.3). The fact that such a 
number of these students was so near the maximum percentile ! 
the gain of 8.6 percentile points for the group quite significant. 


* McConnell, op. cit. 
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ries Wi 


tisfied with an average performance. Two of the greatest losses 


men. 
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students who lost, ranged from the 30th to the 91st percentile 
Nine of the 12 students who had losses were, however, in the 
recent for Lawrence freshmen, 64.2 to 91.5. It seems prob- 
ese students found themselves able to keep pace with their 
hout exerting too much effort and fell into the habit of 
by students who were known at the time to be under great 
s likely of course that the minor losses, as well as the minor 
merely the result of the variability due to the test itself and 

should be 
f the major and growth. 
shed the fact that intellectual growth in the secondary-school 

lent upon factors other than the subject or combinations 


ursued by the pupils. It might be expected that the college 


disregarded. 
Experimental evidence has long 


so dissimilar that the results would vary significantly. The 
wever, on certain course combinations and the apparent faith 
subject fields has led the writer to tabulate the gains according 
the student’s major. The size of the sample has necessitated 
certain majors. The writer has taken the liberty to ecombin 
into four major groups: Fine Arts, Language Arts, Science 
Arts has been considered as a field in itself. 


Fine 
includes majors in English, French, German, Spanish, 


science. 
Arts 
Greek. Science includes majors in biology, chemistry, geology, 
and physies. Social Science has been interpreted as includ 
government, history, psychology, philosophy, religion, and 
tire L\ 


lem. 


1 that these combinations do not make en 


It is recognized 

milies, yet the results may shed some light on the prob 
be indicated that chemistry and biology account for most of 
most of the Language Art 


majors, English and French 


| economies and history all but five of the Social Science 


A 


lhe gains are presented in Table IV. 


TABLE IV 
BETWEEN THE AMOUNT OF CHANGE AND T! 
FIELD OF THE MAJOR 


~ - , 
RELATION 


Freshmen se 
N M Md I Md I I 
4 7é Rg a4 9 g 
Zi 69.2 72.0 74.8 82 f } 
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It would be difficult on the basis of the evidence presented in 7, 
IV to show that any of the large fields of study had superiority , 
any other large fields of study in contributing to intellectual 
ment at the college level. It appears that colleges may soon be i» 
to aecept the finding that any body of content is about as importay: 
any other body of content for intellectual development. It seems 
to the writer that there are factors involved in presenting mater 
stimulating learning, guiding the student, and challenging indepen 
thinking which are of more importance than the particular subject mx 
on which the student does his thinking. 


It is interesting to note that those students who elect to majm, 


Fine Arts rank above students in any other field. The Fine Art 
Lawrence College is not a series of courses pertaining to skills in my 
art, and dramatics. It is rather a field of intellectual endeavor in y 
a student is challenged to think and study with the materials ay 
in the Fine Arts. These students gained as much on the average as! 
majoring in the Language Arts and Sciences. 

The Social Science majors ranked lowest and seem ito have gum 
slightly less on the basis of the mean. The median gain in this 
however, higher than that in any other field. The factor wh 
this difference of 3.4 points between the mean and median for the § 
Science group is. that two students with the greatest losses ; 
group. These losses reduce the mean significantly but do not 
size of the median. 

It would appear from the results of this study that colleges: 
well afford to spend more time considering the problems in 
giving students real intellectual stimulation and less time in 
hours and eredits and arranging for supposedly desirable cours: 
binations. It is highly probable that any professor who looks 
courses aS opportunities to stimulate growth and foster ind 
thinking rather that considering them as subjects to be learned \ 
long run reap significant rewards in student appreciation for th 
lation given. 


CONCLUSIONS 


The results of this study of the intellectual growth of 74 L 
College students seem to justify the following conclusions: 
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ted in T gain in intellectual ability of 8.6 + 2.15 percentile points with 
ratio of four indicates that there is a real improvement in in- 


erlority a 
bility during the college years. 


Udl 


m he » Lawrence College men seem to be slightly below Lawrence College 
important, men in pereentile rank as freshmen. The means are: 69.6 + 2.53 for 
meni’ ind 78.8 1.86 for women, giving a difference of 9.2 + 3.14 with a 

& mat ratio of 2.94. 
indener [he men gained more often than the women, had larger gains, 
hi. 7 fewer losses. 

. 4 The men were still slightly below the women in the senior year 
a difference is not statistically significant. The means are: 
Art 2.08 for the men and 84.2 2.00 for the women, giving a difference 
Ne in (48 = 2.89 with a eritical ratio of 1.67. 

- There appears to be no relationship between the amount of in- 
: | gain and the field in which the student majors. 
uf ppears that at least one-third of the students in this study 

=e nged their intellectual status significantly. This fact presents a chal- 

nge to the college to make certain that each student is stimulated to the 
. of his potentialities. 

ee 7 large gains made by a few students give a strong suggestion 

east some of the students who are admitted to college are a long 


intellectual maturity and therefore need careful guidance which 
result in maximum development. 








ISSUES IN THE CONSTRUCTION AND USE OF 
EDUCATIONAL MEASUREMENTS* 
C. O. MATHEWS 
Ohio Wesleyan University 


Editor’s note: The author presents six important issues in t 
struction and use of educational measurements with a caution that t 


case for measurement be not overstated. 
I will not diseuss eritically all of the assumptions which | 
enumerated by the previous speakers. The one thing which 


stands out in the minds of all of us is the confusion and variety « 


of view which seem to exist. I shall organize my remarks around six 


standing issues which each of us interested in the construction 
of instruments for educational measurement must face. 
1. Shall the point of departure for the construction of val 


ments for educational measurement be a body of subject matter 


boundaries ‘‘are ascertainable with sufficient degree of exact 


shall it be the outcomes of learning (psychological changes in ind 


wh ich have been carefully de fined in terms of behavior)? It will I 
tremendous difference which of these points of view we adopt. If w 


with bodies of subject matter, we will sample by means of caref 

the eontent of textbooks, courses of study, teacher examinat 
other such bodies of content. We will trust to this sampling 

comparison of our test with other tests similarly constructed as 
means of validation. Apparently the most central assumptio 
lying this whole procedure is that there is a eommon body of 1 

learned. 

On the other hand, if we make our point of departure the out 
learning, we will at once ask ourselves what changes in behavior ' 
to measure? How ean these changes be deseribed so that thos¢ 
who have aequired the behavior can be distinguished from t! 


) 


have not? Once we have clearly defined these psychological ¢ 


will then search through any suitable available sources for mi 


materials for the construction of some device to secure evidence as ' 


extent of these changes. We certainly will not be interested 


point of view, in limiting ourselves to knowledge acquired from 


* A discussion before the American Educational Research Association 
Ohio, February 28, 1939, of the contrasting points of view brought 
speakers on one of the programs under the heading of ‘‘ Fundamental Assu 
Edueational Measurements.’’ The four speakers were: Dr. Frederick 5 


Dr. L. Thomas Hopkins, Dr. Ralph W. Tyler, and Dr. Ben D. Wood. 
152 





bodies of subject matter, but will want also to secure evidences in regi! 
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ves in attitudes, interests, points of view, methods of work, and 


avior atomistic, mechanical, and additive in its nature, or 

nitary, organismic, and integrative? In the last few years 

ieal of evidenee has been accumulating to show that behavior is 

composed of a number of separate acts. The findings of 

ings, Childs, Cogwill, Wheeler, Lashley, and the gestaltists support 

is point of view by demonstrating that those descriptions of behavior 

nsist of merely piecing together the descriptions of numerous 

performances are inadequate. The integrative nature of be- 

lls for a kind of measurement which will appraise behavior more 

early in terms of its totality. Perhaps we will have to compromise in 

is ambit to measure behavior as a whole, but we certainly have been 

e past of acting as if we had measured all of it when we have 

| the results of our measures. Certainly the least we can do is 

r more comprehensive measures and to try to be more scientific 
terpretations of the results of partial measures. 


\ technique which is rapidly developing, namely factor analysis, may 
sult in certain conflicts with the integrative point of view. If we isolate 
‘tor analysis more and more detailed independent factors and 
hen through the measurement of each of these expect to get a measure of 
he whole, we may find ourselves in serious conflict with any adequate 


n of behavior. This issue reminds one of the sign hanging 
he neck of the blind beggar standing in front of Grand Central 
New York. This sign read: 


Wars 2 
Wounds 4 
Battles 5 
Wife l 
Children 4 

Total 16 

this total were these words: ‘‘Help the Blind.’’ 
Do local, state, and national testing programs tend to determine 


‘comes of instruction, or do the S¢ programs nrere ly conform 
easure these outcomes? When teachers have a choice in the 
y do not choose to use educational tests which they think meas- 

es widely different from their own. However, teachers fre- 
) not have the choice of such tests in their hands. Administra- 
t ire interested in finding out whether their institutions rank 
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favorably with other institutions often make these choices. (Strange, 
say, this choice is often made without any very clear-cut conception 
the part of either teachers or administrators of the objectives t) 4 
measured. ) 

This raises the issue as to whether or not there is, or necessarily sho 
be, a significant ‘‘common core, varying in nature and magnitude fn, 
subject to subject, but of indispensable importance in all subjects ing 
schools which teach these subjects regardless of differences in margiyg 
emphases.’’ Our disagreements might be nearer an end if we would 
ceive this common core as a common core of objectives and not on¢ 
content. But even so, there is still the problem of measuring that part¢ 
a course or subject which is ‘‘common’’ to other schools and interpret 
the results in the light of the school’s individual goals. 

There is considerable evidence that administrators and teachers mk 
special effort to have their pupils and schools show up well on such ts 
This means that the tests are controlling the outcomes and the emphas 
on the time schedule. The desirability of having a school rank high» 
order to win a scholarship contest or to give a certain amount of prestiz 
to that school and its faculty is a kind of extraneous motivation whid 
may well divert education from its proper channels. If our tests we 
complete and valid measures of all desirable outcomes this would not & 
such an important issue. 

4. Is validity merely inherent in the instrument of measuren 
ts it a much broader concept than this? Of course the content of the te 
rating scale, questionnaire, or observation blank has much to do with 
validity of the instrument. On the other hand, in a practical situation ® 
are interested in the validity of the measure and not merely of the 
utilized. The environmental conditions under which a measuring “ 
is used also affects the validity of the measure. If a child is under! 
tensive emotional disturbances, or if there are disturbing elements 1 & 
environment at the time the measurement is made, it may affect ' 
validity of the outcome. As has been pointed out in recent rest 
studies of child development, the stage of the development ot t 
may be one of these disturbing factors. The same score received by" 
children on an educational measure of some sort may warrant quite“ 
ferent interpretations depending upon the stage of their developme® 
This raises the fundamental question as to just what it is that our’ 
tional measuring device actually measures. We cannot depend as" 
as we have in the past upon surface analyses but must understand = 
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eper meanings which affect the scores on such measuring de- 


part of this whole question of validity it may be well for us to 
whether or not we have placed too much faith in objectivity and 

y. It has sometimes seemed from reading literature in the field 
tional measurements as though some authors placed these con- 
par with validity. There really is no inherent value in objec- 
reliability as such. Our worship of objectivity has probably 
mited us in our experimentation toward new forms of measuring 
is, we have often been content with low validity and with a 


bility due to objectivity. It is necessary for us to understand 





}e supreme importance of validity in this larger sense for unto that meas 
ring device which has validity all things shall be added. 

Should not cross-section pictures of individuals and schools at 

Bined by survey and testing techniques give way to longitudinal pictures 

validly reflect individual development? We have seen a 

leney both in the work of the Progressive Education Associa- 

1 that of the American Council on Education to place more em- 

ion W hasis upon continuous cumulative records of the individual. Any at- 

tests wen mpt to measure behavior which is recognized as unitary and integrative 

ture will demand such records so that the trends and nature of 

Sevelopment may be determined from a more adequate measure of these 

rement haracteristies than ean possibly be furnished by one or a few unrelated 


Have the outcomes of educational measurement (the changes which 
ought about in education) justified the claims made for 
As a consequence of the development of measurement in educa- 
fon | ve a wide-spread use of so-called homogeneous grouping, some 
Bier deterministic types of guidance, an over-emphasis upon those 
spects of learning which tests can measure, and a rather limiting sense 
tor objectivity. 
sed to the above characteristics, which in many ways may be 
ndesirable results of measurement, we have among a number 
ir profession an increased respect for the evaluation of out- 
lesire for adequate data before the making of generalizations, 
gnition of the difficulties involved in trying to measure such a 
etivity as human behavior. The very fact, however, that we in 
$1 ‘room cannot agree upon a few fundamental generalizations or prin- 


erning the measurement of educational outcomes leads me to 
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believe that we cannot be too cautious about our use of these de 
the interest of better education. In spite of my rather negative ert 
I believe that the measurement movement is contributing wor 
outcomes to education. We must be careful not to overstate our mu» 
‘Caution’’ is the watchword until we have arrived at a statement of: 

ciples supported by enough evidence so that we can agree upon the { 

mental nature and value of educational measurement. 








\WS OF NATURE DETERMINE HOW TO MEASURE 
EDUCATIONAL PROGRESS 


Glimpses of Mental Activity 


GEORGE A. Brown, C.E. 
Bloomington, Illinois 


-_ . 
; 


ehiidren are not direetly conscious of the tact, since it is 
0 natural growth toward maturity, their minds are reaching 
questions in an effort to understand fellowship needs as 


it =~ 
th | work together. What we may eall educational progress 
hi is name more than the action of the animal organism fo1 


begins with awakened attention. The psychologists are 
sponses which are beginnings of intelligent action in early 


se observed experiences may be given the double name of 


a 


effort. In this sense the name describes a direct cause of 
es in the growing minds of children. Sensations are hu 
vay to cause the organization of ideas. The mind connects 


ns of persons and things and discovers a means of under 


ee — | 


g. | st and effort name the source of an energy which is char- 
Bcterist ‘human life. The continued action of this energy in human 
i: tional progress. 


name for this energy is human synergy. This name is 


b m the science of biology where it names the energy whicl 


ection of the various organs of a plant or of an animal 


° 


i of all, so that each coop rates to maintain the 1? dividual 


Human synergy combines the energies of individual minds 


Ld 


ind effort of each to advance civilized life in its social 


Se 8 


on with this fundamental synergy (akin to Spearman’s 
n to all intelligence and here described as interest and 
ities are gradually developed in the field of organized 


lowship experiences in this field are concerned not only 
de ST ndings but also with responsive activ ties due to an 


ereative experiences which may or may not result in 


ee =. = 


ince of a richer life for society. 


+ 


itude’’ may be applied to this organizing activity to 


fr 


lefinite meaning as an energy than do the terms ‘‘capae 


intelligenes and yet not so specific as the term tal 


2 = 


1 ere sed, aptitude names the mental energy that organizes 
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ideas through the process we call learning; that is the process of Calning 
an understanding from related experiences and ideas. This energy y 
aptitude holds an attentive interest to certain related fields of experiens 
in connection with ideas and gets a clear perception of the facts j; thep oe 
relation to organizing principles. This direct study finally provide 4 . 
means of knowledge and skill acquired in response to the energy of y» 
tude, and the educational process organizes ideas for use in the yarigy 
fields of human interests. 


The question of a measuring instrument adapted to so complex 3% 
velopment of natural energies is today being considered from varigy 
angles of approach. The measurement instrument question, however ; 
related only to the mathematical device best suited to give as definite; 
measure as possible. In the physical sciences, such devices are related» 
simplifying processes of computation, and, where needed, to indicate om 
bined relations by certain signs; such as the ‘‘—’’ for negative nue 
and the vector sign ‘‘i.’’ The decimal and integral calculus provides fe 
the study of strains and stresses in structures distributed between ps 
itive and negative action from a common center. If any device 
this is needed for measuring educational progress, its purpose will } 
possible, to measure the results of the action of the law of nature 
growth toward maturity, and also the action toward fruition in matw 
fellowship. Vector analysis provides for combining in the same sym! 
measures of known direction and of quantity. Does the law of aptitus 
development involve this combined action? This question is asked simpy . 
to center the discussion on the concept of natural law in the proces « ‘Me 
its development of an on-coming generation. Each individual has & 
urge of synergy, in the form of interest and effort action on brain equp 
ment, by which sensations take on the form of more or less permant! 


= 





ideas. Also, in connection with and as a part of this ability, further su MEH 
growth includes the organization of ideas with the equipment of felor . 
ship relations, to the end that aptitude leads to mutual understanaasgy 


and to the need to learn facts and conditions concerned with cooperit™ 
activities. 4 

In the processes of learning there is what may be described as 4 
and forth movement of ideas and ends by which understanding is 
ened and knowledge and judgment perfected. This action of 
belongs to the educational process as it uses the learnings which hus 
relations, in a free union of common efforts, have developed. In cont “ 
the strong action of a particular talent in one field of expression ™ 
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terest and effort for the wider development of the underly- 
or learning in relation to more common needs of society. 


asizes its own expression as, perhaps, a gift to society. As 


nt to life, this may encourage more interest and effort for 


many communities. 

situation has recognized this need to nurture the growth 
ose relation to growing maturity for the uses of aptitude 
re is a decided contrast between the nurture of growth of a 
nd that of discovering new uses of a physical law, the ac 

s already established. What, then, are the essential uses 

t as a guide to educational progress? Evidently measure- 

1 to the nurture of growing abilities of a nature energy, 
eted with measurement in relation to progress in getting 
facts in their relation to organizing principles. It should be 
d a common unit of measure for the two relations. More- 
rlving energy of synergy is common to both situations. The 

e difference in the measuring conditions is, that the nurture 
| growth of nature-given energy is concerned with a natural 

‘ endowment which determines limitations for one and ex- 
ortunities for another. Knowledge of this condition is of the 
portance for those coneerned with child development. The 
measured abilities is so clearly important to the school teacher, 
es children with various degrees of age growth, that this meas- 
iid be available to guide her work with individuals in all 


‘ement in the field of educational progress in learning has rela- 
t of the school conditions and to all who are directly respons- 
These relations center in the provisions for group codpera- 
earning, and in provisions for skill activities. Nature’s law 
growth is that of an energy which works for an understanding 
organizing ideas and experiences toward agreement within 

es, and with accepted facts of common knowledge. It includes 
ling and judging. Aptitude perceives the significance of 
disagreement between ideas and facts in determining means 
Reflective thinking is required and should, of course, be nurtured 
' the educational process; and this should be done in a way to 
simple and easily seen objective relations toward the sub- 
tuations of the perception of contrasting ideas. School condi 
adjusted from year to year to the need for this nurture. 
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SIGNIFICANT TRENDS IN RESEARCH IN DIAGNOs| 
IN ARITHMETIC 

THERE is an abundance of empirical evidence which shows t 
dial measures applied to the removal of factors interfering v 
n progress will result in suecess if these measures are applie 
crimination. This has been well demonstrated in such areas as 
arithmetic, and language. It must be admitted, however, that ther: 
direct evidence as to the partic ular types of remedial measures 
iseful in dealing with speeifie handicaps nor do we know with any degm 
of assurance what factors or combinations of factors contri 
development of particular types of unfavorable growth of the | 

It is highly significant that much of present day research in 
is being directed to the identification and prediction of handicaps 
stages of learning so that ultimately steps may be taken to prev: 
through the adjustment of the educational program to the ne¢ 
vidual learners. These investigations may be grouped under f 
namely (1) studies in the field of readiness, (2) studies of th 
isties of good and poor achievers, (3) studies dealing with the 
tive organization and gradation of the contents of the eurric 

4) studies dealing with the ways in which learning takes place 
stages of the learning process. 

Studies in the field of readiness have largely been limited 1 
diction of success in reading and arithmetic in the primary gra 
is clear evidence that the tendency in readiness testing is to s 
mere prediction of success to the identification of factors that 1 
fere with learning. There is no reason why these two purposes 0! 
tion and diagnosis should not be served by a well constructed 
readiness tests. It has also been pointed out by several writers t 
ness testing need not be confined to the initial stages of | 
should be extended to higher levels. The possibilities in this 
have been demonstrated by a recently published series of re 
in arithmetie processes for grades 2 through 7. This approach s 
extended to other aspects of arithmetic, for example, social 
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Vt Yan : . 1 ' 
RS ot such topics as area, volume, and other formal phases of th 


of readiness of pupils has been amply demonstrated 


st | is undoubtedly a cause of failure to progress satisfactorily 


WOE ME 2OE BOE 


2 medied by adjusted instruction. 
ee ; 
ARAM 


Seat 


to aid in the location of factors that contribute to unfavorabl 


nt of learners, a number of important investigations, notably 
] 


» hs . Satan } } lnatad ‘ : fF 
Rhos t and his associates, have been conducted to determine altter- 
eteristies Ol good and poor achievers 1n the various areas 


m, primarily in the field of reading and spelling. A valu- 


} 


formation has been gathered which ] 


is highly useful 


in or- 
onal programs. The implications of these researches are 
statement of Gates that the ideal procedure is ‘‘ first and 


idual prescription for individual needs.’’ This type of 


¢ to the identification of causes of poor achievement should 


: : ireas of learning. It is particularly adapted to the 
tie 

importanee of gearing the eurriculum to the develo; 
: so as to facilitate learning has led to numerous studies of 
: t ve ways of organizing the curriculum. The pioneer studies 
( tee of Seven in arithmetic are being extended and checked 

b tigators. There is ample evidence of a wide range of diffi 

s elements of number processes, a fact that raises in 

; t stions as to how best to organize the curriculum for successful 


When should a topie be first introduced? What experiences 


8 ! led to get the child ready for the new topic? Over how 
moi ould the introduction of various phases of a topic be 
‘ilitate and insure learning? How ean the curriculum 

so as to provide most adequately for differences in the rates 


+ . 1 ) 


n learn? These and numerous related questions are un 


their solution offers a rich field 
ted to the problems of organization of 
: ted to methods and materials of instruction. Effective class 

res should clearly recognize information that is slowly being 
ted about how learning takes place. The studies by Brownell 
pa othe v that learning is a gradual process that passes 
s of immaturity until mature procedures result. This find- 
significant in the field of arithmetie since it has been the 
of teachers to expect pupils to acquire mature methods 


e start. The fallacy of this assumption has been demon 
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started by evidence of the value of procedures which stressed meaning 
during the learning process leading ultimately to mastery of desir 
methods of work by pupils. It is a fact worth noting that in these styjix 
the techniques that were devised to study errors made by py 
been used to make longitudinal studies of the learning process under y 
This is an interesting illustration of the intelligent adaptation of , 
cedure developed for one purpose to another purpose for whic! 
ideal. More studies should be made of the nature of the learning | 
how learning takes place, and the influence of various instructior 
cedures that condition learning so that teachers can more intelligent 
direct the learning activities of their pupils. 

Leo J. Bru 


MORE ABOUT REVIEWS OR ABSTRACTS OF 
EDUCATIONAL RESEARCH 


In the November issue of the Journal of Educational Resea 
appeared as written by the undersigned an editorial, the heart o 
may be summed up in two sentences: 

Those preparing reviews of educational research should not 
port the investigations which are obviously so faulty in procedw 
to make the conclusions unreliable. To report to teachers and s 
administrators such studies without sufficient detailed deserip' 
the sources of the data and the techniques of treating them so 
ethical. (Page 302.) 

In the December issue of the Journal, Dr. Samuel W. Fernh 
eminent psychologist takes the position that to fail to report eve! 
made in a field is unethical. 

There is considerable merit to Dr. Fernberger’s statem 
afraid however that he did not visualize clearly the situation ! 
mind. Dr. Fernberger was apparently thinking of abstracts of sus 
which were in reality condensations of individual studies. What ! 
mind more particularly was reviews of research studies in which te® 
dividual researches, particularly its technical procedures, w' ; 
scribed in detail. It is unfortunate that in the title of my edito 
the word ‘abstract.’’ 

Dr. Fernberger is apparently thinking of abstracts prepared ! 
scientists in the field concerned. I am thinking, primarily, otf 


’ Ne 


tended for field workers who would apply the results of rest 
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ernberger says, ‘‘But one expects the reader of an abstracting service 
e original those articles that interest him or that may be valu- 
s field of work.’” One may know without the slightest shadow of 
hat not only will the very large majority of readers of reviews 
tional research, teachers and school administrators never see the 
ticles, but the majority of them could not understand nor evalu- 
nieal procedures and terminology employed. ‘To pass on as 
these people the results of investigations which by accepted 
s of valid procedure are clearly faulty and unreliable, and thus to 
em, is not only unfortunate, even unethical, but little short of 

nd charlatanism. 
tract or a review of educational research is neither critical 
Dor t rr if done by one who is not competent to judge of the re- 
f the procedures of investigation, the reader should be so warned 
ding of the review or abstract should be such as to avoid care- 
suggestion that the conclusions of the investigation may be 
In other words it should be little more than a rather full an- 
graphy of research in the given field. 


is take an actual ease, in which I prefer not to use names. Mr. A, 


B craduate student, in his M.A. thesis reports that there is no difference 
p relative efficacy of two methods of teaching history of the United 

\ reading of his thesis reveals that one of the methods was a com- 
paratively novel one with which the teacher had little previous experience. 


sses of approximately 20 pupils each were employed in the experi- 

ment. Of these, 24 pupils in each class were mutually paired for the pur- 

rg DOs ling constant certain variables particularly the learning abili- 
wo groups of subjects. The pupils are paired on the basis of 
[.{). on a certain intelligence test. Their progress was measured by 

a tive test requiring 90 minutes. A reviewer reports that Mr. A 
fference between the relative efficacy of the two methods as 
nvestigated under experimental conditions with two eleventh 

sses. In the review he does not note that (1) since I.Q. and not 

A. was held constant that: (1) one class may have been more capable 
ng than the other; (2) one method was relatively handicapped by 

- ‘experience of the teacher with it; (3) the investigation does not 
lescribe the method well enough to enable us to know what the ex- 
mental variable actually was; (4) since no measure was had of the 
lities possessed by the pupils at the beginning of the experiment period, 
son the test at the end of the experiment period probably do not 
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represent the amount of growth; (5) the rest were tests merely of syhies 
matter information of the detailed type and afforded no means of moss 


ing some of the important objectives of teaching history. In sum } the st 
viewer after assuming a role of technical competency in which the ) vet at 
is encouraged to have faith, passes on to untrained and unsus; educat 


teachers conclusions, which they will accept for facts, which are for n time 


their scientific window dressing probably no better than a good guess 


For anyone to hold that this sort of disservice should be cont blishec 
that it serves any good end, places a severe strain upon logical process Rice of 
Let us take another example, Dr. B in a study of what factors ar « A. and 
sociated with the relative effectiveness of teachers focused upon two sult of 
fieations of teachers—those at the upper end of the distribution rot ed 


tively suecessful ones and those at the lower end, the relatively uns 

ful ones. For each teacher in these groups he has data concerning: 
number of years of Latin studied in high school. He takes as a me 

of the relationship between success and number of years of Latin, bis 

r, a procedure clearly inapplicable and certain to yield a coefficient ¢ 
relationship much higher than that obtained by valid procedures. A fer 
years later a man of international reputation and enormous 
among teachers in this country, most probably mislead by a review 
study, for this great man does not ordinarily concern himself wit 
complicated statistical studies, seized upon this unwarranted cone 

of the study to support his point of view that the study of Latin mor 
than the study of other subjects develops qualities making for t 
success. 

Cases of this sort could be cited by the score. For anyone to m 
that to report uncritically such studies is anything but a disservice 1s 
cult for me to imagine. Dr. Fernberger need have little worry ' 
reason of the failure to report these amateurish researches, the loss « 
valuable discoveries such as Mendel’s work in genetics may be expert 
What is more unlikely is that in this day of uncritical attitudes t 
this huge amount of research of varying degrees of competence, 1s ' 


+) 


studies of real value will be ignored rather by reason of the 1 
everyone is busy doing research that few have time to read it al 
few read but a small part of the huge and increasing amount 
uneritically with but poor understanding. 

Dr. Fernberger says ‘‘the failure of a review to abstract 
lished paper, if he knows it exists, is unethical.’’ His discuss 
seem to suggest that I condone or approve the failure to re} 
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sers. 1 did not diseuss the issue. I believe with Dr. Fernberger, that 
viewer of the research on a certain point or problem should examine 
| the studies available whether published or unpublished, whether easy 
t or not. Under the conditions that prevail, we are not doing that 
ation. Reviewers do their work, for the very great part, on their 
time as a labor of love and on their own expenses. In the successive 
‘the Review of Educational Research, it is the exception if an un 
| thesis is reported. Yet in the bulletins of the United States 
f Edueation, there are listed annually more than two thousand 
| Ph.D. theses in education carried on in this country alone. As a 
ese omissions as well as the uncritical and superficial review 
itional research, teachers and others who wish to know what 
offer them tend to rely too trustingly or perhaps too sus 

upon ‘‘reviews of research.’’ 
ndeed unfortunate that in these days of granting hundreds of 
nds of dollars by the foundations to projects which even if success- 
f so questionable value to education, that no funds are available 
e payment of salaries of competent technical experts to review edu- 
| research and to report its most probable sound conclusions to the 
ls of thousands of workers in education. Shortly there will appear 
yelopedia of educational research. No funds were available to em 
n adequate staff of critical and competent abstractors and reviewers 
s were distributed to scores of men and women who on spare time 
whatever technical competence in statistical and research meth- 
y possessed, prepared reports in their fields. Serviceable as this 


rclopedia will be, how much more reliable and useful this work might 


n if funds had been available to finance exhaustive and critical 


is needed in education by teachers, parents, and administrators, 
e that is now not available. They do not need reports of all 
t research giving us, impartially, conclusions of loose, amateur- 
es at research, but reviews and syntheses by interpreters who 
nt and who have available the time to search exhaustively for 
h done on each problem, to scrutinize each investigation criti 
ligest and evaluate it and to tell us all as far as can be told, what 
know about the thousands of unsettled problems that hold us 
ition. May the time come when that service is available. 


Hart R. Douaiass 
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Address all communications relative to book reviews to Editor 
Kai Jensen, University of Wisconsin, Madison, Wisconsin, 


i 


HARRISON, M Reading Readi 


ness. Revised Edition (Boston: Hough- 


LUCILE. 


Os 


ton Mifflin Co., 1939), pp. vil + 255 

$1.40. 

The first edition of this book, which 
appeared in 1936, was concerned with 


problems of reading readiness in the pri- 


This material, with little 
the text 


mary grades. 


change, revised aa 


Part I for 


the initial period of reading instruction.’’ 


appears in 


under the title of ‘‘ readines 


Items considered include 1) factors 
which influence reading readiness, (2) 


instruction to foster reading readiness, 


the testing program, and (4) sug 
gestions for placement and remedial work. 
Mental age is correctly considered an im 
portant determinant of reading readiness. 
[t is advised that all children be provided 
with a rich and varied experience as a 


preparation for reading. Unfortunately, 
as in the first edition, Harrison tends to 
accept uncritically the claims made by 


authors of tests. 


Part II of the text concerns itself with 
eading readiness at educational levels 

ond the preparatory level. Although 
n general all the higher levels are sup 
posed to be covered, most of the discus 
sion is confined to grades below the high 
school The chapter on the nature of 
reading is exceptionally well done. Un 
due emphasis upon the mechanics of read 
ing and other narrow viewpoints, such as 
the development of rhythm reading, are 
severely criticised In defining reading, 
the 1uthor makes use of desirable ele 
ments from many points of view. Due 


consideration is given the important part 


played by recognition of symbols which 


serve as stimuli for recalled an 
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A 
biblio 
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structed meanings and the 
i these ‘‘meanings in tl 
esses according to the purposes 


reader 


The requisites for reading 


ing at levels beyond the preparator The M 


riod and the instructional 


readiness to carry out the tl 
of reading Pr 


are outlined. 


made for the development 
the 


necessary concepts for 


meanings in terms of the specific » 
terial to be read. This 

through direct experience : 
vicarious or indireet expe 


former is preferred Other 


program to 


develop rea 


making provision for vocab 


ment, understanding of sentences, 
reading according to purpos 
It Is sugye sted that <« = 


matter teacher should als« 


of reading since they are 
fitted to guide the student in the think 
side of reading such mate 


Extensive bibliographies 
reports and on materials f s 
reading readiness prograt y 


th Also probl 


tne a 
tor 


ppendix. 


eises are given mater 
each chapter. 
Thi 


prominence 


s excellent book WwW 1] 


e to the prol 


readiness at the higher 


in the primary grades. 


gram of reading readiness 
eational levels is basically 8 
movement will without 


more widespread in the ne 
MILes A 


Unwersity of Minnesoia 
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Editor 
sin 


ix 


Wisconsin. 


TINS 

Syivia. ‘* The His 
ducation in Waldo 

Maine,’’ 

XLII, No. 4 


Press, 


nties in 


niversity 


to trace the 
counties to 
historical, so 

ns of the va- 
educational atti- 


of the peo] le 


In balance, 
Sensation and Percep- 
[ (Meadville, Pennsyl- 


View Company, 1939 


presents previously unpub- 
iability and validity 

the lateral im 

sual Sensation and 
the Betts Ready to 
» Education 


December 1, 1939, 


eryvice 


Washington, D. C.: 
School A ] 


arch Division of 


n of 
ion Association, 


itional Researel 
of articles taken 
id dealing with: 
al problem, a pro 
tion, the child 


Address all communications relative to research abstracts and 
bibliographies to A. S. Barr, University of Wisconsin, Madison, Red 


R 
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and the school, the future of the endowed 


university, our schools: 
and miscellany. 


LUNN, J. E., ET AL Pupil Pe 


Study of Pupils in Minnesota 
Part I, 


Minnesota State 


Schools, 
Pa. }- 


Education, 


Sections 1] 
Depart: 
1939), 171 pp. Mimeo- 
graphed. 
Presenting the results of studies of 


pupils in Minnesota schools, these five 


bulletins include: comparison of dull 


children and bright children as problem 


cases, the relation of certain personality 


traits to other educational factors, com- 
of rural and urban pupils in the 
ade, 


conditions to educational 


lation of 


parison 


ninth gr relation of environmental 


results, and re 
comprehension in reading to 


other factors in educatior 


REINHARDT, EMMA, BEU, 
HAEFNER, 


Student 


RALPH. 
State Teachers College During 
Year Period 1925-26 to 193: 
ern Illinois State Teache 


No. 147 


study < 


es ¢ 


laetre l. and 


f 
i la 


students at 


Eastern Illinois State Teach 


ers College, during t} 
1925-26 
Research 


tatior 


Divisior 
Washin 
Division, Nat 








tion, November, 1939), 17 pp. Mimeo- 

graphed. 

This bulletin contains a list of 204 ref- 
erences to help the educator interpret to 
the public the purposes and achievements 
of the public schools. 

Research Division. 1939 State Legislative 
Progress of Teacher Retirement (to No- 
vember 1, 1989) (Washington, D. C.: 
Research Division, National Education 
Association, December, 1939), 7 pp. 
Mimeographed. 

The Research Division presents an an- 
alysis of teacher retirement laws passed 
in state legislatures during 1939. 
Research Division. Status of Teachers’ 

Salary Schedules for 1939-40 in Cities 

over 100,000 in Population (Washing 

ton, D. C.: Research Division, National 

Education Association, October, 1939), 

26 pp. Mimeographed. 

This bulletin contains data from an in- 
quiry sent in September 1939 to superin- 
tendents of schools in cities over 100,000 
in population. 

Research Division. Bibliography on Youth 
Problems (Washington, D. C.: Research 
Division, National Education Associa- 
tion, November, 1939), 38 pp. Mimeo 
graphed. 

This bibliography provides 250 refer- 
ences on: the status of youth, earning a 
living, personal development, keeping 
healthy, going to school, belonging to so- 
ciety, religious growth, foreign youth, and 


other bibliographies. 


SMITH, HENRY LESTER, AND EATON, MER- 
RILL THOMAS ‘*An Experimenta! 
Study of Standards for the Selection of 
Candidates for Teacher-Training Insti- 
tutions,’’ Bulletin of the School of 
Education Indiana Uniwersity, XVI, 
No. 1] December, 1939), 72 pp 
After reviewing previous investigations 

the authors present the results of the 


study of the pre-training selection of 
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[Fol 


teachers at Indiana University « 
which they conclude that the qualir 


those entering teaching can | 
through selection. 


SWEETMAN, EpwaArb. History of 


the 


1 


DE ImMproy 


yy 


bourne Teachers’ College and Itz Pn: 
cessors, Australian Council for } 


tional Research, Series No 
bourne: Melbourne Universit; 
1939), 144 pp. 


vu 
a 


The author presents a historical gr, 


of the personalities associated 


uM 


the policies of the Melbourne Teach, 


College, Australia. 


TYRON, CAROLINE McCann. F; 


of Adolescent Personality by Ai 


cents, Monographs of the Soc 

Research in Child Develo; 

IV, Serial No. 23, Number 4 

ington, D. C.: National Resear 

cil, Society for Research in ( 
velopment, 1939), 83 pp. 

The author presents a detailed 
of data from the California Growt 
relative to the evaluation of 
personality by adolescents 
Woop, BEN D. 19389 Fall Testi 

in Independent School 

mentary Studies, Educati 

Bulletin No. 29 (New Y 

tional Records Bureau, J 

50 pp. 

This bulletin contains a su! 
the test results of the Bur 
ing program, and articles or 
bility of the American Cour 
tion Psychological Examir 
Edition; a study of the n 
the Iowa Silent Reading T 
schools and colleges; and so! 
the revised Strong Vocat 
Blank. 

EDUCATIONAL ADMINISTRA 

SUPERVISIOD 
GoetscH, HeLen B. ‘‘ Relat 


ental Income to College O 


D 





Review, XLVIII (January, 


r presents data to show that 
f bright boys and girls at 
on the economic status 


4 AND OBJECTIVES 
iM G ‘* High School Pu 
n Magazines and News 
XLVIII 


School Review, 
40), pp. 40-48, 
second of 

results of a recent survey of 


two articles re- 


and activities of 


nterests 


pupils in Chicago. 


AND TEACHING 


LEARNING 
LARRY A. 
“asts Pay?’’ 


[II (November, 1939), pp. 





‘*Do Science 


Science Edu- 


of a 
ly of the 


schools in which he finds 


the results 


sents 


radio in 


rs are favorable to radio and 
esult of its use made impor- 
nt 3 in their teaching 
AND KAMBLY, PAUL E., 
parison of Three Types of 
Activity in Directing the Study 
Science Educa- 


1939), pp. 


’ . ‘* 
ner science 
XII November, 
+} 


ie results of an 


Ss present 
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experimental study of three methods of 
teaching science, namely the ‘‘individ- 
ual,’’ ‘‘group,’’ and ‘‘help requested’’ 
methods from which they conclude that 
the individual is most effective. 
WINTERS, ict 

tion of the Meanings Which Students 

of Science at Different Levels 

Associated with Selected Scientific Con 
Education, XXIII 


ELwoop J. Determina 


Grade 
cepts,’’ Science 
(November, 1939), pp. 331-335. 
The author presents data from which 
he concludes that either too much time is 


given to the memorization of facts or it is 


more difficult to instill scientific attitudes. 
MEASUREMENTS, STATISTICS, AND 
SCIENTIFIC TECHNIQUES 

GRANT, ALBERT. ‘‘ Results of Nelson Sil- 
ent Reading Test in Grade IX,’’ The 
School Review, XLVIII (January, 

1940), pp. 34-39. 

This article presents an analysis of the 

results of the Nelson Silent Reading Test 

for more than three thousand ninth grade 


pupils in the Cincinnati public schools. 
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Address all research news and communications to Carter V. 
Good, Teachers College, University of Cincinnati, Cincinnati, 
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Plans for Completion of the Diction- 
ary of Education.—During the Christmas 
holidays, at the Chicago meeting of the 
National Council of Phi Delta Kappa, 
plans were approved for completion of 
the Dictionary of Education. The se- 
quence of steps for the next two years is 
approximately as follows: 

1. Completion of the preliminary 
work of definition by approximately 150 
coordinators or specialists and their as- 
sistants, working in as many subdivis- 
ions of education, by December, 1940. 

2. Submission of definitions for 
criticism to other experts in the ap- 
propriate fields early in 1941, followed 
by any necessary revisions, to be made 
by the original authors of the defini- 
tions. 

3. Editing of copy for release to the 
publisher by December, 1941. 

4. Proof reading early in 1942. 
The National Council also authorized 

the National Executive Committee to sign 
a contract with McGraw-Hill Book Com- 
pany for publication and sale of the Dic- 
tionary, which will be made available at 
a special discount to members of Phi 
Delta Kappa. Royalties will accrue to 
the fraternity in return for the support 
given to the project. 

Origin and Sponsorship of the Project. 
—Phi Delta Kappa voted at the Cincin- 
nati meeting of the National Council (De- 
cember, 1937) to sponsor preparation of 
a comprehensive educational dictionary. 
This action had been preceded by a period 
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of preliminary work to which a numb 
of individuals and organizations 
tributed. The Dictionary of Education js 
under the supervision of a committee (, 
pointed by the Executive Committee o 
Phi Delta Kappa) whose membership eo 
sists of: Carter Alexander, Columbia Uni 
versity; W. W. Charters, Ohio State Un 
versity; Paul M. Cook, ex-officio, exer 
tive secretary, Phi Delta Kappa; H. D 
Rinsland, University of Oklahoma; W 
Ray Smittle, Wayne University; and Car 
ter V. Good, chairman, University of Cin 
cinnati, who is in charge of the editor 

office at Cincinnati. 

Purpose and Contribution.—The pr 
mary purpose is to prepare a compr 
hensive dictionary of technical terms 
education which will do for educations 
workers and teachers what already he 
been accomplished by technical diction 
aries for practitioners in such special 
fields as medicine, law, engineering, an¢ 
psychology. The Dictionary will promote 
greater clarity and consistency of usage 
in educational literature and in classroom 
instruction. Since the plan is on 
sponsorship by Phi Delta Kappa, throug! 
& supervisory committee, and of cooper 
ative participation in the definition 
terms by codrdinators or key men in ‘8 
rious chapters, who are enlisting the a 
of their associates, advanced classes, 30! 
seminars, the stimulation given to lo 
chapters and to individuals through ¢ 
Sperative effort should be as valuable ' 
Phi Delta Kappa as is the Dictionary " 
self to the field of eduaction. 
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The Master List of Words and the 
Handbook.—The first step was the prep- 
aration of a master list of words and a 
handbook of procedure, under the super- 


yision of the Committee on Dictionary of 
The list of words has been 


Education. 
mimeographed in the form of a 122-page 
klet, including some 19,000 entries. 
22-page handbook of 

also has been issued in mimeographed 


[It deals with the Dictionary proj- 


information 


terms of origin and sponsorship, 
rpose and contribution, scope and de 
on, a description of the master 
ist of words, subdivisions of education 
biblio- 
on educational terminology, and 
The list of terms and 


included, illustrative definitions, 
tters of form. 
handbook have been placed in the 
ands of coérdinators or specialists rep- 
esenting some 150 subdivisions of educa- 
1 also have been distributed to the 


i8 officers and chapters of Phi Delta 
Kappa. 

At a later date the complete list of 150 

r more specialists will be made available 

h the columns of the Phi Delta 

A few of the fields are not yet 

finally assigned to codrdinators, due to 


4 


Kappan. 


inability to accept on the part of some 
specialists and difficulty in locating ex- 
perts for certain other areas. 


Cooperatwe Study in General Educa- 
The Coéperative Study in General 
Education, operating under the sponsor- 
ship of the American Council on Educa- 
hon, involves the codperation of twenty- 
two colleges. The general aims are to as- 
sist faculties in redefining aims; to assist 
faculties in evaluating their program of 
general education; to develop within the 
perating institutions faculty leaders 
apable of stimulating and conducting in- 
ternal programs of evaluation and cur- 
research; to demonstrate the 
value of coéperative efforts among educa- 


neulum 
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institutions; and to 
means for the effective dissemination of 


tional provide a 
the results of educational experimenta- 
tion. 

The twenty-two colleges work codépera- 
tively. The Codperative Study is not a 
survey, nor is it merely a study of speci- 
fied aspects of general education. The 
Study concerns itself with problems that 
faculty members in coéperating institu- 
tions identify and define, not with ready- 
made lists of problems. The activities of 
the central staff grow out of the expressed 
needs of faculty investigators in the col- 
leges. In a real sense members of the 
staff aim to serve as assistants to faculty 
investigators. Faculty requests determine 
the direction of central staff activities. 

One major purpose is to explore the 
possibilities of various codperative pro- 
eedures. Colleges have common problems. 
The codperative study of such problems 
should serve the mutual interests of all 
concerned. One means of codperative at 
tack is the establishment of inter-college 
committees to work on various aspects of 
common problems. Another is a provision 
for summer workshop opportunities in 
which faculty members spend five weeks 
together in the concentrated study of in- 
dividual problems. Furthermore, members 
of the central staff visit the codperating 
colleges upon the request of the institu 
tion. In some instances, faculty leaders 
in the codperating institutions spend six 
months in the office of the central staff 
working as fellows. This experience pro- 
vides training for the professor who will 
later assume leadership in the program of 
faculty studies of general education in his 
own institution. 

The foregoing emphasis upon the codp- 
erative study of common problems does 
not indicate any lack of concern with 
problems which are peculiar to an institu- 
tion. If a codperating college is interested 
in a problem which concerns that college 
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alone and if the college regards this prob- 
lem as important, the resources of the cen- 
tral staff are available to that college as 
it studies its unique problem of general 
education. 

At a two-day conference of liaison offi- 
cers of the cooperating colleges, the group 
unanimously agreed that topics for spe- 
cial emphasis for 1939-40 should be the 
following: (a) study of student needs; 
(b) development of a comprehensive pro- 
gram of evaluation; (c) study of student 
personnel administration; (d) develop- 
ment of administrative procedures within 
the institutions to facilitate the Codpera- 
tive Study; (e) codrdination of Coépera- 
tive Study activities with related activi- 
ties of other national groups; and (f) 
development of clearing-house service. 

Ralph W. Tyler directs the Study. 
Other members of the staff include Ralph 
W. Ogan as Associate Director, research 
associates, and research assistants. The 
research associates in science, humanities, 
and social science have their major gradu- 
ate education and experience within the 
subject-matter fields in which they work. 
None is an educationist in the strict sense 
of the term. All of these men became 
interested in research in problems of 
teaching through their college teaching 
experiences. Each believes that there is 
much necessary research to be done in this 
field, just as in the field of the subject- 
matter discipline itself. 

The office of the central staff is located 
at the University of Chicago, 6010 Dor- 
chester Avenue, Chicago. 


Evaluation of School Broadcasts.—Dur- 
ing the first two years of the Evaluation 
of School Broadcasts investigations, the 
staff has constructed tests and other in- 
struments of appraisal to evaluate 
changes in attitudes, interests, ways of 
thinking, information, and selected skills, 
as these have been influenced by listening 
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to and utilizing school broadcasts 4 
music, science, social studies, and liter. 
ture. During the past year, the sy 
has designed and administered controljs 
experiments to evaluate selected outcoms 
for local, regional, and nation-wide brog) 
cast series. 

Studies of local broadcasts included t 
evaluation of a literature series in () 
cago, & music series and a systhesisj 
school-learning series in Detroit, a mux 
series in Rochester, New York, a scien» 
recording series in Cicero, Lilinois, and; 
news broadcast series in Rochester «ap; 
Detroit. 

Studies of regional broadcasts include 
a music series in California and othe 
coast states, the Standard School Broa) 
cast, WLS ‘‘ Music in America,’’ Chicagy 
and a conservation series of the Ohi 
School of the Air, over Station WOST 
Ohio State University. 

Studies of nation-wide broadcasts ix 
cluded selected program series of the \» 
lumbia Broadcasting System and the Ns 
tional Broadcasting Company. From tie 
Columbia Broadcasting System’s Amen 
can School of the Air, the music series 
science series, social studies series, «1 
literature series have been investigate 
For the National Broadcasting Compaz 
the Music Appreciation Hour (Dao 
rosch), Series A, the lessons in the play 
ing of orchestral instruments (Madi) 
and the social studies series enti 
‘*Tdeas That Came True’’ were invest 
gated. 

An extension of the Evaluation 
School Broadcasts studies for a three-yes’ 
period has led to the development of ne" 
plans and projects. As these plans 3 
developing, three major types of studié 
will be carried on. They include a Com 
munity Study, Wide-Sampling Studie 
and Special Studies of selected loc 
school broadcasts, 
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The Community Study has been de- 
ned to permit very intensive and ex- 
nsive studies of the effects of in-school 
school administration, 


yadcasts 


upon 
sion, teaching practices and pupil 
ides, information, ways of thinking, 
motional adaptability. Such broad- 


include Columbia Broadcasting Sys 


tem’s ‘‘ Frontiers of Democracy,’’ ‘‘ Folk 
Music of 


> 


America,’’ and ‘‘Tales From 
rand Near.’’ For similar purposes se 
broadcasts such as 
hildren’s serial programs, and ‘‘Gang 
broadeasts will be 
died. Such effects as improvement in 
ritical thinking, changes in social, politi- 
and economic attitudes, and the emo- 
il adaptability will be related to soci- 
gical and psychological factors in the 
ls’ backgrounds. 


The Wide-Sampling Studies have been 


lesigned to permit extensive rather than 


ve studies of the effects of the same 
In 
rder to judge the validity of generaliza- 


tens 


ions which may grow out of an intensive 


ly of a similar 


lies will 


single community, 


be carried on in the schools 


f Los Angeles County, California; Hous- 


Denver, Colorado; Detroit, 
Rochester, New York; Toledo, 
Akron, Ohio; and Trumbull, Con- 


n, Texas; 


» Special Studies of local broadcasts 
en designed to permit evaluation 

f the effectiveness of programs produced 
tilized under the direction of local 

is of education in Chicago, Illinois; 
roit, Michigan; Cleveland, Ohio; and 
New York. The Evaluation of 
ol Broadcasts staff, located at Ohio 


hester 


state University, will codéperate by gath- 
ring evidence which will permit local 


| officers to appraise and to improve 


their broadcasts. I. Keith Tyler is direc- 


rand J. Wayne Wrightstone, who pre- 
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pared this progress report, is associate di 
rector. 


Teacher Examination § Service.—In 
order to make available to school superin- 
tendents the best resources and devices 
now known for selecting teachers and to 
promote research for the improvement of 
teacher selection methods and devices, a 
teacher examination service has been or- 
ganized by the American Council on Edu- 
cation with the aid of a grant from the 
Carnegie Corporation through the Car- 
negie Foundation for the Advancement of 
Teaching. The American Council on Edu 
cation has undertaken the project after 
consultation with a group of superintend 
ents, some of whom have been using cet 
tain tests of the Codperative Test Servic 
for several years as a part of their total 
selective procedure. These superintend 
ents believe that there is a crucial need 
will 


avoid the costly duplications and uncer 


for an examination service which 
tainties of locally assembled examinations 


for teacher candidates; which will give 


reliable and valid measures; and which 
will be comparable from year to year and 
from one school system to another. They 
point out that the need for comparable 
measures of the intellectual status of can 
didates for admission to the teaching pro 
fession has been clarified and accentu- 
ated by the revelations of the Carnegie 
Foundation’s Pennsylvania Study, the 
annual reports of the Teachers College 
Personnel Association, and the American 
Council’s testing programs, While this ex- 
amination service is designed primarily to 
aid superintendents in their efforts to im 
prove the selection of new teachers, it is 
obvious that the opportunity to ‘‘regis- 
ter’’ talents on a national scale, in terms 
of widely comparable units, will have very 
great advantages for the candidates and 
institutions preparing teachers. 

The American Council has placed the 


teacher examination project in charge of 


PE Ee 
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a National Committee on Teacher Exam- 
inations, of which Supt. A. J. Stoddard 
of Philadelphia is chairman. The com- 
mittee plans to develop a three-fold serv- 
ice. First, the committee will make avail- 
able to the cities coéperating in the ex- 
periment a battery of carefully con- 
structed tests. The task of constructing, 
administering, and scoring these exam- 
inations, and of reporting the results, has 
been assigned to the Codperative Test 
Service, of which Ben D. Wood is direc- 
tor. Second, the committee will supply as 
much information as possible to the co- 
Operating school systems relative to other 
aspects of the teacher-selection process 
now in use, including those dealing with 
the so-called ‘‘imponderables.’’ It will 
not, however, try to furnish tests of per- 
sonality, mental adjustment, or other 
characteristics which must be considered 
by the local school administrator. Third, 
the committee will furnish data and lend 
all possible assistance to promoting re- 
search in teacher education and guidance. 
Recognizing clearly both the importance 
and complexity of the problems involved 
in these services, the committee will 
closely codrdinate its activities with the 
work of the Council’s Commission on 
Teacher Education. 

The first examination will be held on 
March 29-30, 1940, in a dozen or fifteen 
centers. 


Local Units in Ten States.—The Office 
of Education supplies interesting infor- 
mation concerning local school unit or- 
ganization in Arizona, Arkansas, Cali- 
fornia, Illinois, Kentucky, North Caro- 
lina, Ohio, Oklahoma, Pennsylvania, and 
Tennessee. This information on the or- 
ganization and administration of schools 
was collected with the codperation of 
chief state school officers and state proj- 
ect staffs. Other state agencies such as 
universities, planning boards, highway 








































Febri 
departments, tax commissions, the WP, 
and PWA lent their assistance. T, 
states surveyed enroll approximately 1), — 
000,000 pupils in about 50,000 schoo, ee °™¢ | 
Their educational problems are typical — 
those which may be found in other states for | 

The survey report, ‘‘ Local School Uni = 
Organization in 10 States,’’ not only & 
scribes in detail the present-day orga 
ization and administration of school sy. 
tems in the several states, but also tracy 
the historical background and develop 
ment of local school districts. The repor 
presents proposals by the state proje: 
staffs for improving public-school orgu 
ization and administration, and suggest: 
ways for making desirable changes. Other 
problems treated include inequality of 
ability to support education and inequal. 
ity of educational opportunity, the mu 
tiplicity of small schools and small dis 
tricts, failure to assign responsibility for 
planning district reorganization, obstacle 
to the reorganiaztion of school units, and 
relationship of size of school to desirable 
educational conditions. 

The director of the ‘‘Local Schou! 
Units Project’’ was Henry F. Alves, U.§ 
Office of Education Specialist in State 
School Administration, who served in 4 
supervisory and consultative capacity t 
the state project staffs, each of which 
sumed responsibility for the preparation 
of the state project report, available fron 
the state department of education. I 
addition to the survey report, ‘‘ Loca 
School Unit Organization in 10 States,’ 
the Office of Education has issued a sec 
ond report on ‘‘ Principles and Procedure 
in the Organization of Satisfactory Local 
School Units.’’ 
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8.39 by the Corporation to organiza- 
ns and individuals in the United States 
in the British Dominions and UCol- 

es, Of this sum, $697,200 was given 

for library interests, $1,157,325 for the 
irts, $1,253,650 for research, studies, and 
publications, $204,921 for adult educa- 


r 
tion, and $1,533,030 for the general pro- 


gram of the Corporation. The largest 
grant made during the year was $250,000, 
given to complete the sum necessary to 


establish joint academic library services 
for Vanderbilt University, Peabody Col- 
and Searritt College at Nashville, 
Tennessee. Commenting on this grant, 
Mr. Keppel stated that it ‘‘may well pro- 

le an example for the other communi- 


a 


ties having a group of educational in 
stitutions. ’’ 

Grants for scientific research totaled 
$137,500, and those for educational in- 
vestigation, $233,550. Grants were made 
to the amount of $432,500 for the pur- 
pose of carrying forward the work of the 
Institute of International Education, 
with headquarters in New York, and that 
of the New Zealand Council for Educa- 
tional Research. The American Associa- 
tion for Adult Education, the National 
Occupational Conference, the Committee 
n Scientific Aids to Learning, and the 
American Law Institute received a total 
f $295,400 for work in their respective 
fields, and $177,000 was voted to the As- 
sociation of American Colleges, the Amer- 
ican Council of Learned Societies, and the 
National Bureau of Economic Research. 
Grants of $500,436 were made for the 
British Dominions and Colonies. In South 
Africa these funds have been used chiefly 
for scientific inquiry; in New Zealand and 
Australia emphasis has been on educa- 
tional research, libraries, and social serv- 
ices. In Canada grants have been made 
primarily to continue research programs 
in colleges and universities and to for- 
ward library extension. 
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Colorado Study.—The Bureau of Edu- 
cational Research and Service of the Uni- 
versity of Colorado is undertaking a sur- 
vey study in order to determine which 
specific problems in learning and teaching 
are of the most vital concern to teachers 
in the field. 
sent to approximately 


Questionnaires have been 
1000 elementary 


and secondary-school teachers in Colo- 


rado, soliciting codperation in reporting 
specific difficulties in the classroom on 
which the findings of educational research 
and study would be particularly helpful. 
On the basis of frequency of occurrence, 
the most important of the problems 
reported will be selected. Later in the 
year, the Bureau plans to issue a bulletin 
in which such selected problems will be 
analyzed and a synthesis presented of 
pertinent research findings. The investi- 
gation will, incidentally, attempt to de- 
termine whether there are significant un- 
solved problems with which educational 
research should deal. The director of the 


Bureau is R. A. Davis. 


Art.—The 
Iowa has completed the third and final 
volume of its Studies in the Psychology of 
Art, directed by Norman C. Meier, and 


Studies in University of 


published by the American Psychological 
Association. 
ten-year investigation of the nature and 


These studies represent a 


variations of artistic capacity and fac- 
tors affecting aesthetic response and 
learning in the art education field. Volume 
I, published in 1933, was concerned chiefly 
with the early genetic aspects of artistic 
capacity, while Volumes II and III con- 
cern themselves primarily with the upper 
grades, high school, and adult levels. The 
concluding study in Volume III presents 
for the first time a new theory of artistic 
aptitude based on all the evidence un- 
covered either experimentally, statisti- 
cally, or by case studies during the ten- 


year period. The program was sponsored 
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by the Carnegie Foundation for the Ad- 
vancement of Teaching with funds of the 
Carnegie Corporation of New York. The 
procedure involved a merging of psycho- 
logical, art, and educational viewpoints 
and was participated in by research as- 
sistants representing all three interests 
under the guidance of Professor Meier. 


Iowa Projects.—Iowa State College is 
carrying forward a number of projects 
in connection with the Rural Education 
Sub-section of the Iowa Agricultural Ex- 
periment Station. 

Uniform County Maps for Each Iowa 
County.—(Barton Morgan, leader; pre- 
pared in codperation with the Iowa State 
Planning Board.) It is the purpose of 
this project to make available to research 
workers, and others interested in educa- 
tion, uniform county school maps for the 
99 counties of lowa. These maps show 
county, township, and section lines; school 
district boundaries; locations of school 
buildings; types of school districts; 
roads; and principal streams. They are 
drawn three-fourths inch to the mile and 
are in one color. The final tracings of 
these maps should be completed by June 
15, 1940, and Van Dyke negatives pre- 
pared by July 1, 1940. The maps will be 
printed to order, either singly or in quan- 
tities, at a price which will cover only the 
cost of printing and handling charges. 
(Project 461, State.) 

Nature and Extent of the Need for Ed- 
ucation in Agriculture for Beginning 
Farmers in Iowa.—(Barton Morgan and 
J. A. Starrak, leaders.) The main objec- 
tives of this project are: (1) to discover 
the amount and kind of agricultural edu- 
cation possessed by beginning farmers in 
Iowa, (2) to secure an estimate of the 
amount and kind of agricultural educa- 
tion that beginning farmers in Iowa need, 
and (3) to gather such other data as are 
fundamental to planning a more adequate 
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program of agricultural education in this 
state. The data sheet used lists severg) 
hundred items under such genera! heaj 
ings as the following: personal informs 
tion, general education, agricultural edy. 
cation, occupational experience, outstand 
ing problems and difficulties encountered 
success in meeting agricultural problems 
social and personal adjustment, etc. The 
sample census technique is followed. 4 
field man began work in September of 
1938 and has to date interviewed over 6() 
young farmers located in all sections of 
the state. The field work was complete) 
about April 1, 1939, and a manuserip; 
will be prepared by March 1, 1940. (Proj 
ect 590, State.) 

Part-time Education in Vocational 
Agriculture.—(T. E. Sexauer, leader. 
The purpose of this study is to discover 
means for evaluating the effectiveness of 
part-time schools in agriculture, to de 
termine the factors which will make part 
time work effective as an agency in com- 
munity development, and to ascertain 
their influence in getting young mea 
started in farming. The data are being 
collected in the office of the State Board 
for Vocational Education and in the 
schools maintaining part-time classes in 
agriculture. These data include: 


a. Expenditures for part-time educa 
tion in vocational agriculture. 


b. Active schools, 1928-1938. 

ce. Enrollment in courses, ages. 

d. Councils, program of work, farm 
practice. 

e. Date of starting and closing session: 
per week. 


f. Growth, 1928-1938. 


The project should be completed by 
July 1, 1940. (Project 597, State.) 

Factors Affecting the Supply and De 
mand of Home Economics Teachers 
Iowa.—(Hester Chadderdon, Florence 
Fallgatter, and Barton Morgan, leaders. 
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T bjectives of this project are: 
determine the available personnel 
“a for home economics positions in Iowa high 
schools from 1935-1942, and (2) to de- 
ne the nature and size of the de 
; , for high school home economics 
— rs in Iowa from 1935-1940. Data 
relative to the numbers of teachers hav 
Te r to be graduated in the various 
, ns will be secured from the regis- 
; trar’s offices of each institution preparing 
s in the state. Records in the 
, the State Superintendent of 
: Instruction and of the State Board 
; nal Education will be con 
2 sulted ¢ » data relative to number of 
eated outside of lowa, num 
sitions in the state, number of 
s placed, tenure, years of ex 
cs nd subject combinations of 
s teachers. The placement 
ness 
; the institutions preparing 
s will yield information on the 
‘ ‘ mbinations demanded and the 
f teachers securing positions out 
: state. A sampling of teachers 
Wi nterviewed to determine reasons 
: for short tenure, and the extra-class re 
es of teachers. A group of 
. : : tendents of schools will also be 
_— secure data on reasons for 
8 nure community restrictions on 
‘ ~ ‘tivities, and any community 
strative desires for more 
s in home economics. Interviews 
with a sampling of college 
§ 3 1 college counselors to de 
so far as possible, reasons for 
g teaching as a profession. Thes 
analyzed and compared with 
arlier studies to determine 
; factors affecting the situation 
s to complete this project by 
4] 
prs u t te Work in the Teache s Colleges 


The Board of 


ders t ersity of Michigan In July, 1938, 


Regents of 
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passed a resolution approving a formal 
request from the state board of education 
that the University of Michigan cooper 
ate with the four teachers colleges of the 
state in planning a program of graduate 
instruction to be offered at these institu 
tions. According to the action taken, a 
graduate division has been organized at 
each of the teachers colleges. The admin 


istration of these divisions is the t 


join 
responsibility of the teachers colleges and 


} 


the graduate school of the University. The 


final authority for the control of these 
graduate divisions lies with the state 
board of education and the Board of Reg 


ents of the University, but the immediate 


control is vested in the executive board 
of the graduate school functioning 
through two agencies: (1) an advisory 


council appointed by the president of eac! 
of the tea 
uate adviser to teachers colleges, Clifford 
Woody, appointed by the Board of Re 
ents. 


o\ +} 


chers colleges and 1e 


According to the codperative plan of 


operation the same standards and require 
ments governing graduate work at the 
University of Michigan prevail in the 
graduate divisions of the teachers l 
leges. The students are admitted to grad 

ate study by the dean of the graduate 
school at the Universitv; they schedul 
their program of work according to the 
regulations of the graduate school and the 
various dey artments thereof; they receive 


their degrees from the University, unless 


perchance as much as three-fourths of the 
work for the degree has been cor plete 
in courses offered in a graduat ivis 
cet hers college, in which cas 
tl U ( vy and the t ers colle 
will be designated on the diploma granted 
Instructional Staff The 1e! ers f 
the instructional staff i graduate « 
visior of a_ teache ( ege ind the 
courses offered aré roved by the ex 
ecutive board of the graduate school of 
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the University of Michigan. The staff 
members of a division are of three types: 
members of the regular staff of the Uni- 
versity of Michigan, members of the staff 
of other universities or educational 
agencies employed by the University of 
Michigan, and members of the regular 
staff of the teachers college. Usually the 
first two types of staff members assume 
full responsibility for the courses offered, 
but the third type of staff member, i.e., 
the staff members of the teachers colleges, 
have associated with them a member of 
the University staff known as a sponsor, 
who offers counsel and advice in planning 
the course, gives one or more lectures and 
makes helpful suggestions in the conduct 
of the course. The relationship of the in- 
structor and the sponsor is identical with 
that which often prevails at the Univer- 
sity when a more experienced instructor 
codperates with a less experienced one in 
the conduct of a course. 

Program of Instruction—The pro- 
grams of work offered in the graduate 
divisions during the 1938-39 academic 
year were naturally limited. Graduate 
courses were offered at but two of the 
teachers colleges, Michigan State Normal 
College and Western State Teachers Col- 
lege. At the former institution, which had 
already made arrangements to codperate 
with the School of Education in offering 
& program of graduate instruction for 
teachers of special education, four courses 
in special education were offered during 
the first semester. At the latter institu- 
tion, four graduate courses were given 
during the second semester: two in edu- 
cation, one in English, and one in history. 
Seven students, enrolled full-time, elected 
the courses offered at Michigan State 
Normal College; 115 students, enrolled 
part-time, elected the courses at Western 
State Teachers College. 

During the summer of 1939 courses 
were offered in the graduate divisions of 
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all four of the state teachers college 
The number of courses offered and ths 
number of students enrolled are as /). 
lows: 


Number of Number of 


Institution Courses Students 
Central State..... 6 56 
Michigan State 

ee ee 7 20 
Northern State... 6 57 
Western State.... ll 154 


The courses offered at each institution, 
except at Michigan State Normal College 
were distributed approximately even); 
among the academic and professions 
studies. At Michigan State Normal (0): 
lege, only general professional course 
and courses in special education were 
given. At Northern State Teachers (- 
lege, all courses were taught by instruc 
tors who were members of the graduate 
faculty of the University of Michigan o 
were provided by the University. At the 
other institutions part of the instructors 
were from the staff of the University : 
were provided by the University and par 
were selected from the staffs of the tea 
ers colleges. 

During the 1939-40 academic year, pri 
grams of courses are being offered in th 
graduate divisions of all of the teacher 
colleges except Northern State Teachers 
College, which to date desires to hav 
courses given in the summer session ‘ 
At Central State Teachers College thre 
courses are planned for each semester 
at Michigan State Normal College, s1 
courses during the first semester and tv 
during the second semester; and at West 
ern State Teachers College, six cours 
during each semester. The enrollment 
during the first semester is as follows: # 
Central State Teachers College, 36 par 
time students; at Michigan State Norms 
College, 6 full-time and part-time st 
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Western State Teachers College, lems, facilities, and 


’ 


e students. teachers colleges; 


servations The facts cited from the teachers 


s sections will give som of similar problems, 
nature and extent of the 


i 


rk developed in the cod; 


era 


nent between the University fi 


-olleges. However, at considerable 


progress has 
lirected to three fea the development of graduate 


wi 
_ ay pon teachers college I + _ 
ut into operation. teachers colleges, t may seem 
umber of grad rate t this devel pment has bee! 
each institution. Slow. However, there 
offering le] at what pri 
f is real. Many unsolved 


hey are being 
itured that 


Ww 


the leading universities di 


years af 
been first in 


m was 


the enroll- 
en ugh to 
While lim 


‘ourses to 


reduced the 


Operatio 


t 
»} 


( ers c¢ 


tion outlined above 


ht about many con 
ff members of variou rts are 
>» Uy rreityw oa i PF +hea nec no eomY T » axt of the 
€ niversity and of the nearing completio! i n n 


A 


es. The instructors from investigation 


e learned of the prob in selected c 
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tutions engaged in training teachers for 
small rural schools. 


Theses on Micro-films.—The School of 
Education has joined with the other 
schools of Pennsylvania State College in 
making its dissertations available on 
micro-films. These are produced by Uni 
versity Microfilms, Ann Arbor, Michigan. 


This plan includes: 
1. A volume of four or five page ab 
stracts of all Doctors’ dissertations 
of the university, published by the 


university. 


a] 


A film of each complete disserta- 
tion, copies of which may be pur 
chased from the producer, or bor- 
rowed from the Library of Pennsyl- 
vania State College. 

3. A volume published by University 
Microfilms annually, listing all of 
the dissertations of the cooperating 


universities. 


Studies of Reading at Syracuse Uni 


versity.—M. E. Troyer is doing research 
on the development of films for remedial 
treatment in the fields of reading and 
arithmetic. The Educational Clinic, of 
which Virgil E. Herrick has charge, is 
concentrating its research in the field of 
reading. Studies under way are con 
cerned with: visual factors in relation to 
reading, social adjustment of children in 
grades one to three and reading success, 
the background of experience and its re- 
lation to meaning for children in the ele- 
mentary school, and emotional maladjust- 
ment of children in relation to progress 


in reading. 


Cod} eratwe Test 


function of any general testing 


Service.—The pri- 
mary 
program is to provide accurate and mean 


ingful measures of the attainments of 
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students in basic subjects and in brog 
fields. These measures furnish inform 
tion that is essential for intelligent gt 
dent self-guidance, for educational apj 
vocational counseling, for adapting jp 
struction to individual differences 
backgrounds and needs, for improving 
supervisory procedures, and for evaluat 
ing curricula, teaching methods, ap 
other general features of the educations 
program. 

The preparation of a codrdinated bat 
tery of tests for high school use is, 
large undertaking. The Codperative Tex 
Service, a nonprofit agency of the Amer 
ican Council on Education, was estat 
lished primarily for the purpose of de 
veloping such tests. Examinations 
several general fields and in nearly ai 
the major academic subjects of high 
school instruction are now available. Tw 
years ago the first editions of the Re 
Coéperative Achievement 
Most of these ar 


Because of the 


vised Series 
Tests were issued. 
40-minute examinations. 
care used in selecting for inclusion on 
the best items from long lists, these tests 
have adequate reliability for indtidu 
diagnosis in most cases, and at the same 
time they are short enough to be 4 
ministered in a single class period of tle 
usual length. Scaled Scores and dif 
ferentiated norms make possible a vs 
riety of meaningful comparisons betwee 
the results of one test and another 
well as between those of one form 

edition and another, and facilitate th 
use of profile charts and permanent cum 
lative record forms, These examinations 
and the accompanying interpretative ms 


te 


terials are now offered as tested instr 


ments for annual measurement program 
at the secondary level. 
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